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(54) Selective refinement of meshes 

(57) An efficient, lossless, continuous-resolution 
representation (the "PM representation") of highly 
detailed geometric models for computer graphics spec- 
ifies a succession of progressively more detailed polyg- 
onal meshes (i.e.. "progressive meshes") as a base 
polygonal mesh and a sequence of complete mesh 
refinement transformations (e.g., the vertex split trans- 
formation) that approximate the model at progressively 
finer levels of detail. Procedures for storing and trans- 
mitting geometric models using the PM representation 
address several practical problems in computer graph- 
ics: smooth geomorphing of level -of -detail approxima- 



tions, progressive transmission, mesh compression, 
and selective refinement. An optimized mesh simplifica- 
tion procedure constructs the PM representation of a 
model from an arbitrary polygonal mesh, while preserv- 
ing the geometry of the original mesh as well as its over- 
all appearance as defined by its discrete and scalar 
appearance attributes such as material identifiers, color 
values, normals, and texture coordinates. In particular, 
the PM representation and these procedures preserve 
discontinuity curves such as aeases and material 
boundaries of the geometric model. 
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Description 

COPYRIGHT AUTHORIZATION 

5 A portion of the disclosure of this patent document contains material which is subject to copyright protection. The 

copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclo- 
sure, as it appears in the Patent and Trademark Office patent file or records, but otherwise reserves all copyright rights 
whatsoever. 

K- FIELD OF THE INVENTION 

This invention relates generally to geometric modeling using polygonal meshes for computer graphics, and more 
particularly relates to techniques for optimizing display, storage and transmission of varying level of detail polygonal 
mesh models. 

15 

BACKGROUND AND SUMMARY OF THE INVENTION 

Models in computer graphics are often represented using triangle meshes. Geometrically, a triangle mesh (e.g.. 
example portion of a triangle mesh 82 of Fig. 6) is a piecewise linear surface consisting of triangular faces joined 

20 together along their edges. In the following discussion, the geometry of a triangle mesh is denoted by a tuple (K.V). 
where /Cis a simplicial complex specifying the connectivity of the mesh simplices (i.e.. the adjacency of the vertices, 
edges, and faces), and V-{v^ ..... is the set of vertex positions Vj = {xpyj,2j) defining the shape of the resh in R^. More 
precisely, a parametric domain, |K'|(=R'^, is constructed by identifying each vertex of K'with a canonical basis vector of 
R"'. and the mesh is defined as the image, <i>i^(|Kl). where (|)^,:R"'->R^ is a linear map. (See. e.g.. H. Hoppe et al.. Mesh 

25 Optimization, 1 993 Computer Graphics Proceedings 1 9-26.) The vertices of a triangle mesh (e.g.. vertices 82-89 of the 
mesh 80 of Fig. 6) are denoted as v, ..... v^; the edges (e.g.. 92-95) denoted by pairs of adjacent vertices as e={vj.vj ; 
and the faces (e.g.. faces 100-107) denoted by triples of interconnected vertices as f={Vj,Vf^,v /} . 

In typical computer graphics applications, surface appearance attributes other than geometry (i.e.. the above 
described simplicial complex and vertex positions tuple (K, V)) are also associated with the mesh. These attributes can 

30 be categorized into two types: discrete attributes and scalar attributes. Discrete attributes are usually associated with 
faces of the mesh. A common discrete attribute, the material identifier, determines the shader function used in render- 
ing a face of the mesh, as we!! as some of the shader function's global parameters. As an example, a trivial shader func- 
tion may involve simple look up within a specified texture map. (See, e.g.. S. Upstill, The RenderMan Companion 
(Addison-Wesley 1990).) 

35 Many scalar attributes are often associated with a mesh, including diffuse color (ng,b). normal (nx.riyn^, and tex- 
ture coordinates (u.v). More generally, these attributes specify the local parameters of shader functions defined on the 
mesh faces. To capture discontinuities in the scalar fields, and because adjacent faces may have different shading func- 
tions, it is common to associate scalar attributes not with vertices of a mesh, but with its corners. (See. e.g., Apple Com- 
puter, Inc.. 3d Graphics Programming with QuickDraw 3d (Addison-Wesley 1995).) A corner is defined as a 

40 (vert ex, face) tuple. Scalar attributes Sf^j^ at a corner c=(vj,ff^) specify the shading parameters for face f at vertex v. As 
an example, to model a crease (a curve on the surface across which the normal field is not smooth), one identifies a 
curve (sequence of edges) in the mesh; at each vertex along its path, the curve partitions the corners into two sets; two 
normals are associated with the vertex, one for each of these sets. A mesh with scalar and discrete surface attributes 
is thus denoted as a tuple M=(K,V,D,S) where D is the set of discrete attributes df associated with the faces 

45 f={vj. v^,Vf}^ K. and $ is the set of scalar attributes SfyQ associated with the corners (\/,f) of K. 

In the continuing quest for realism in computer graphics, highly-detailed geometric models are rapidly becoming 
commonplace. Using current modeling systems, authors can create highly detailed geometric models of objects by 
applying versatile modeling operations (e.g.. extrusion, constructive solid geometry ("CSG"). and free-form deforma- 
tions ("FFD")) to a vast array of geometric primitives (e.g.. non-uniform rational B-spline ("NURBS") and implicit sur- 

50 faces ("Btobbies")). (See. T. Sederberg and S. Parry, Free- form Deformation of Solid Geometric Models, 1986 
Computer Graphics Proceedings [FFD]; Rockwood, Real-time Rendering of Trimmed Surfaces. 1989 Computer Graph- 
ics Proceedings [NURBS]; and J. Blinn, A Generalization of Algebraic Surface Drawing, 1982 ACM Transactions on 
Graphics 1(3)235-256 [Blobbies].) For display purposes, these authored models are usually tessellated into triangle 
meshes of the type previously described. Detailed models can also be rapidly obtained by scanning physical objects 

55 with structured light systems, for instance laser range scanners, to also create meshes. In either case, the resulting 
complex meshes are expensive to store, transmit, and render, thus motivating a number of practical problems. 

Mesh Simplification . The meshes created by modeling and scanning systems are typically not optimized for display 
performance. In most applications, these initial meshes can usually be replaced by nearly indistinguishable approxima- 
tions with far fewer faces, thereby improving rendering efficiency. At present, the computer user (e.g., graphical artist or 
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designer) is often responsible for this hand-tuning of meshes, much the same way programmers tinkered with assennbly 
code before the advent of optimizing compilers. A far better approach is to develop mesh simplification tools to auto- 
mate this painstaking task. As another benefit, such tools allow porting of a single model to platforms of varying per- 
formance. 

5 Level -of -Detail Approximation . When a detailed mesh is far from the viewer, it may occupy only a small region of 

the screen. Significant work must be e)(pended to render the mesh only to have it affect a small nunnber of pixels. 
Instead, a far coarser mesh (i.e., one with fewer vertices and faces) would look almost identical. To address this prob- 
lem, many applications use several versions of a model at various levels of detail. A fully detailed mesh is used when 
the object is close: coarser approximations are substituted as the object recedes. (See. T.A. Funkhouser and C.H. 

10 Sequin. Adaptive Display Algorithm for Interactive Frame Rates During Visualization of Complex Virtual Environments. 
1993 Computer Graphics Proceedings 247-254). Further, instantaneous switching between two levels-of-detail of a 
given model can lead to a perceptible "popping" display effect. For this reason, the capability of constructing smooth 
visual transitions-called geomorphs -between meshes having different levels-of -detail is desirable. 

Progressive transmission . A complex mesh consumes considerable time to transmit over a communication line, 

15 often many times longer than it takes to visually render images with views on the mesh. When a mesh is transmitted 
over a communication line, one would like to render views that show progressively better approximations to the model 
as data is incrementally received. The simplest known approach is to render the individual ti-iangles as they are 
received, but of course this looks exti-emely poor. Another prior approach is to transmit successive level-of -detail 
approximations, but this requires additional transmission time. 

20 Mesh compression . A model should be stored in the smallest amount of memory or disk space. There have been 
two orthogonal approaches to dealing with this problem. One is to use mesh simplification, as described earlier, to 
reduce the number of faces in the model as much as possible while preserving its appearance. The other is mesh com- 
pression: minimizing the space taken to store the model given that a particular mesh has been selected. 

Selective refinement . When switching to a more detailed mesh of a level-of -detail representation, detail is added 

25 uniformly over the model's surface. For some models, it is desirable to refine the mesh only in selected regions. For 
instance, as a user flies over a terrain model, one would like to show the terrain in full detail only near the viewer, and 
only within the field of view. 

There exist a number of mesh simplification techniques that address these problems with varying success. A tech- 
nique described in G. Turk. Re-Tiling Polygonal Surfaces, 1992 Computer Graphics Proceedings 55-64 [hereafter 

30 "Turk92"]. sprinkles a set of points on a mesh, with density weighted by estimates of local curvature, and then retrian- 
gulates based on those points. 

Both W.J. Schroeder et al., Decimation of Triangle Meshes, 1992 Computer Graphics Proceedings 65-97 [hereafter 
"Schroeder-etal92"] and A. Varshney. Hierarchical Geometric Approximations, PhD tiiesis. Department of Computer 
Science, University of North Carolina at Chapel Hill (1994) [hereafter •'Varshney94"] describe techniques that iteratively 

35 remove vertices from the mesh and retriangulate the resulting holes. The technique in Varshney94 is able to bound the 
maximum error of the approximation to a user-specified tolerance by defining two offset surfaces to the original mesh 
and using combinatorial searching. 

H. Hoppe et al.. Mesh Optimization, 1993 Computer Graphics Proceedings 19-26 [hereafter Hoppe93] describes 
a technique, referred to as mesh optimization, which simplifies an arbitrary original mesh by applying successive ti^ans- 

40 formations selected from a set including edge collapse, edge split and edge swap so as to minimize an energy function. 
As shown by a graph 25 of Fig. 2 having an accuracy axis 26 and a conciseness axis 27, this energy function explicitly 
models the competing goals of accuracy and conciseness by sampling a dense set of points from the original mesh, 
and using these points to define a distance metric between a more simplified mesh resulting from a selected transfor- 
mation and the original mesh. 

45 More specifically, tine goal of the mesh optimization method described in Hoppe93 is to find a mesh M=(K. V) that 
both accurately fits a set X of points Xj e and has a small number of vertices. This problem is cast as minimization 
of an energy function 

E(M} = E^^,(M) + E,^p(M) + E^p,,^(M) (1) 

so 

of accuracy and conciseness: the distance energy term 

E^,JM):=L,d^(x,.<fyJ\K\)) ■ (2) 

55 measures the total squared distance of the points from the mesh (i.e., a measurement along the accuracy axis 26). and 
the representation energy term 

^crepW = C,,^ m (3) 
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penalizes the number m of vertices in M (i.e.. a measurement along the conciseness axis 27). 

The third term, the spring energy E^fj^^^M) is introduced to regularize the optimization problem. It corresponds to 
placing on each edge of the mesh a spring of rest length zero and tension k: 

5 ^springm = ^ ff./c; e K - ^ (4) 

Hoppe93 describes minimizing the energy function E(M) using a nested optimization method having an outer loop 
and an inr:rr loop. In the outer loop, the method optimizes over K, the connectivity of the mesh, by randomly attempting- 
a set of three possible mesh transformations: edge collapse, edge split, and edge swap. This set of transformations Is 

ic complete, m the sense that any simplicia! oomplex K of the same topological type as K can be reached through 
sequence of these transformations. For each candidate mesh transformation. K K'. the continuous optimizatio:^ 
described below computes Ef^, the minimum of E subject to the new connectivity /<"'. If aE=: F ^^-E ^ is found to be neg- 
ative, the rnesh transformation is applied (akin to a zero-temperature simulated annealing method). 

In the inner loop performed for each candidate mesh transformation, the method computes 

IS min ^E^j-^j{ ^+E^p^^g(V) by optimizing over the vertex positions V. For the sake of efficiency, the algorithm in fact 

optimizes only one vertex position Vs, and considers only the subset of points X that project onto the neighborhood 
affected by K K: 

The regularizing spring energy term Espring(M) is found in Hoppe93 to be most important in the early stages of the 
optimization. The optimization method therefore achieves best results by repeatedly invoking the nested optimization 

20 method described above with a schedule of decreasing spring constants »c 

Hoppe93 also demonstrates use of this mesh optimization method as a mesh simplification tool. Given an initial 
mesh M{q.q., example initial arbitrary mesh shown in Fig. 1 (a)) to approximate, a dense set of points X is sampled both 
at the vertices of M and randomly over its faces. The optimization method is then invoked with initial mesh M as the 
starting mesh. By varying the setting of the representation constant c^^p, the optimization method takes different paths 

25 34-36 through a space of possible meshes 38 and thereby can produce optimized meshes M^, M^, and with differ- 
ent trade-offs of accuracy and conciseness. For example. Figs. 1(b-d) show views of three example optimized meshes 
M^. M^, and M^. respectively, produced from the example original arbitrary mesh (Fig. 1(a)) by the prior mesh optimi- 
zation method of Hoppe93 for different values of the representation constant Crep- 

J. Rossignac and P. Borrel. Multi-resolution 3D Approximations for Rendering Complex Scenes, Modeling In Com- 

30 puter Graphics 455-465 (Springverlag, New York 1993) [hereafter "Rossignac-Borrel93"] describes a technique of 
merging vertices of a model using spatial binning. A unique aspect of their approach is that the topological type of the 
model may change in the process. Their scheme is extremely fast, but since they ignore geometric qualities like curva- 
ture, iheir approximations are far from optimal. 

The above-described mesh simplification techniques create a discrete hierarchy of simplified models by succes- 

35 sively applying their simplification method several times. Both Turk92 and Rossignac-Borrel93 are able construct geo- 
morphs between the discrete set of models thus created. 

More recently. M. Lounsbery et al.. Muftiresotution analysis for surfaces of arbitrary topological type. Technical 
Report 93-10-05b, (Department of Computer Science and Engineering, University of Washington, January 1994) [here- 
after Lounsbery-etaI94] have generalized the concept of multi resolution analysis to surfaces of arbitrary topological 

40 type. M. Eck et al.. Multiresolution Analysis of Arbitrary Meshes, 1995 Computer Graphics Proceedings 173-182 [here- 
after "Eck95"] describes how this wavelet-based multiresolution approach can be applied to the approximation of an 
arbitrary mesh. They first construct a parameterization of the mesh over a simple domain, and then expand that param- 
eterization on a wavelet basis. They are able to bound the maximum error between the original mesh and any approx- 
imation. 

45 In the present invention, the above problems are addressed by methods and apparatus for storing, transmitting and 
rendering views of an arbitrary polygonal mesh M using a format, referred to herein as a progressive mesh ("PM") rep- 
resentation, that represents the arbitrary polygonal mesh as a much coarser mesh f\/f together with a sequence of n 
detail records that indicate how to incrementally refine A/' exactly back into the original mesh M~M" . In an illustrated 
embodiment of the invention, each of these records stores information associated with a vertex split, an elementary 

50 mesh transformation that adds an additional vertex to the mesh. The PM representation of M thus defines a continuous 

sequence of meshes A/f^,/W' A/f" of increasing accuracy from which I eve! -of -detail approximations with any desired 

complexity can be efficiently retrieved. Moreover, smooth visual transitions (geomorphs) can be efficiently constructed 
between any two such meshes. In addition, the PM representation naturally supports progressive transmission, offers 
a concise encoding of M itself, and supports efficient selective refinement. In short, the PM representation offers an effi- 

55 cient. lossless, continuous -resolution representation. 

The present invention also provides a new simplification procedure for constructing a PM representation from a 
given mesh M. Unlike previous simplification methods, this procedure seeks to preserve not just the geometry of the 
mesh surface, but also its overall appearance, as defined by the discrete and scalar attributes associated with its sur- 
face. 
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Of the prior mesh simplification techniques discussed above, the multi resolution analysis (MR A) approach of Eck95 
has some similarities with the PM representation. The MRA approach also stores a simple base mesh, together with a 
stream of information that progressively adds detail back to the model. The MRA approach likewise produces a contin- 
uous-resolution representation from which approximations of any complexity can be extracted. However, the PM repre- 

5 sentation of the present invention has a number of differences from and advantages over the prior MRA approach. 

First, the MRA approach utilizes detail terms in the fornn of wavelets that specify transformations which recursively 
split the faces of a base mesh. This requires the detail terms or wavelets to lie on a domain with subdivision connectivity. 
As a result, each level of detail approximation, including the highest, must belong to a restricted class of meshes (those 
with subdivision connectivity). An arbitrary initial mesh /W (with arbitrary connectivity) can only be approximately recov- 

w ered to within an e tolerance, and never exactly. 

In contrast, the PM representation of the present invention is lossless. Each detail record is a complete mesh 
refinement transformation which can produce progressive meshes {M'\\<n of the PM representation) having any arbi- 
trary connectivity. As a result, the progressive meshes can be much better approximations geometrically of the original 
arbitrary mesh /Wthan the counterpart approximating meshes of the MRA approach. Furthermore, the highest-detailed 

15 model in the continuous-resolution family. A^. is exactly the original art>itrary mesh M. (Compare, e.g.. the illustrative 
MRA approach meshes shown in Figs. 4(a-d) to the illustrative PM representation meshes shown in Figs. 7(a-d).) 

Additionally, the MRA approach cannot deal effectively with surface creases (cun/es on the surface across which 
the surface is not smooth), unless those creases happen to lie parametrically along edges of the base (least level of 
detail) mesh. The progressive meshes constructed according to the invention, however, can introduce surface creases 

20 anywhere on the mesh surface arxJ at any of the I eve Is -of -detail. 

Additionally, the PM representation can capture both continuous, piecewise-continuous. and discrete appearance 
attributes associated with the surface. Such attributes include diffuse color, normals, texture coordinates, material iden- 
tifiers, and shader parameters. To represent functions with discontinuities, prior MRA schemes can use piecewise -con- 
stant basis functions, but then the resulting approximations have too many discontinuities since none of the basis 

25 functions meet continuously. (See, e.g., P Schroder and W. Sweldens. Spherical Wavelets: Efficiently Representing 
Functions on the Sphere. 1995 Computer Graphics Proceedings 161-172 (the Haar wavelet basis).) Furthermore, it is 
not presently clear how MRA could be extended to capture discrete attributes. 

Finally, the PM representation of the invention allows geomorphs between any two levels-of-detait meshes with dif- 
ferent discrete attributes. This is not possible with prior MRA approaches. 

30 Additional features and advantages of the invention will be made apparent from the following detailed description 
of an illustrated embodiment which proceeds with reference to the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 The file of this patent contains at least one drawing executed in color. Copies of this patent with color drawings will 
be provided by the Patent and Trademark Office upon request and payment of the necessary fee. 

Certain of the drawings executed in color are images of meshes created from a dataset entitled Cessna which was 
originally created by Viewpoint Datalabs International, Inc. of Orem, Utah. U.S.A. 

Figs. 1(a-d) are views of an arbitrary mesh (Fig. 1(a) with 12.946 faces) and a set of simplified approximating 
40 meshes at' multiple levels of detail (Fig. 1 (b) with c^ep =10-"* and 228 faces; Fig. 1 (c) with c^ep= 10'^ and 370 faces; and 
Fig. 1(d) with Crep=10"^ and 1194 faces) produced according to a prior mesh optimization method described in 
Hoppe93. 

Fig. 2 is a graph of accuracy versus conciseness illustrating the results of the prior mesh optimization method 
described in Hoppe93 for the example approximating meshes shown in Figs. 1(b-d). 
45 Fig. 3 is a block diagram of a software system for viewing level of detail approximations of a mesh according to the 

illustrated embodiment of the invention. 

Figs. 4(a-d) are views of a set of meshes (with 192 faces and i;=9.0 tolerance (Fig. 4(a)); 1 ,070 faces and t;=2.75 
tolerance (Fig. 4(b); and 15,842 faces and e=0.1 tolerance (Fig. 4(c-d))) constructed according to the prior MRA 
approach to approximate an original arbitrary mesh /Wand illustrating that, in comparison with the meshes constructed 
50 by the illusti-ated embodiment of the invention which are shown in Figs. 8(a-d). the prior MRA approach does not 
recover the arbitrary mesh M exactly, cannot deal effectively with surface creases, and produces inferior quality level- 
of-detail approximations of the arbitrary mesh M. 

Fig. 5 is a block diagram of a computer system that can be used to implement a method and apparatus embodying 
the invention for storing, transmitting and rendering views on progressive meshes using a PM representation. 
55 Fig. 6 is a block diagram of portions of example initial and resulting triangle meshes illustrating two inverse mesh 

transformations, an edge collapse operation and a vertex split operation. 

Fig. 7 is a block diagram of a PM representation data structure for representing a succession of level-of-detail 
approximations of an arbitrary original mesh M according to the illustrated embodiment of the invention. 

Figs. 8(a<l) are views of three exemplary meshes {/^ with 50 faces in Fig. 8(a); with 200 faces in Fig. 8(b); 
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and A/f with 1000 faces in Figs. 8(c-d)) out of a set of progressive meshes specified in an exemplary PM representa- 
tion according to the illustrated embodiment of the invention. 

Fig. 9(a) is a flow diagram of a method for creating geomorphs between two meshes in a PM representation 
according to the illustrated embodiment. 
5 Fig. 9{b) is a flow diagram of a method for evaluating the geomorphs created by the method of Rg. 9(a). 

Figs. 10(a-j) are views of exemplary geomorphs /W^(a) defined between two meshes, ti/P(0)^M^^^ (with 500 faces) 
and {\P(1)^M*^^ (with 1000 faces), specified In a PM representation of the progressive mesh sequence shown in Rg. 
24 and evaluated at a={0.0. 0.25. 0.50. 0.75. and 1 .0}. 

Fig. 1 1 is a block diagram of a system according to the illustrated embodiment of the invention for progressively 
w transmtriing and displaying views of a three dimensional obi=a based on the PM representation. 

Figs. 12(a-b) are flow charts of a transmitting method and a receiving method in the system of Fig. 1 1 for progres- 
sively transmitting and interactively displaying views based on the PM representation. 

Fig. 13 is a block diagram of a vertex split transformation specified In a PM representation and illustrating encoding 
of attributes in a vertex split record with predictive and delta encoding for mesh compression. 
75 Fig. 14 Is a flow chart of a method according to the Illustrated embodiment of the invention for selective refinement 
of a mesh based on the PM representation of Fig. 7. 

Fig. 15 is a flow chart of an alternative method according to the Illustrated embodiment of the Invention for selective 
refinement of a mesh based on the PM representation of Fig. 7 and using a closest living ancestor condition. 

Figs. 1 6(a-b) are views of exemplary meshes produced by selective refinement within a view frustum according to 
20 the methods of Figs. 14 (with 9.462 faces shown in Fig. 16(a)) and 15 (with 12.169 faces shown in Fig. 16(b)), respec- 
tively. 

Fig. 1 7 Is a flow chart of a further modification of the methods of Figs. 13 and 14 for selective refinement of a mesh 
based on the PM representation of Fig. 7 which maintains more detail near silhouette edges and near the viewer. 

Figs. 18(a-b) are views of an exemplary mesh (with 7.438 faces) produced by selective refinement within a view 
35 frustum according to the method of Fig. 17. 

Fig. 19 is a flow chart of a mesh simplification method according to the illustrated embodiment of the Invention for 
constructing the PM representation of an arbitrary mesh. 

Fig. 20 Is a graph of accuracy versus conciseness Illustrating the results of the mesh simplification method shown 
in Fig. 19. 

30 Figs. 21(a-c) are views of a simplified mesh (Figs. 21(b-c)) produced from an exemplary arbitrary mesh (Figs. 21 (a) 
- a mesh with regular connectivity whose vertex colors correspond to the pixels of an image) according to the simplifi- 
cation method of Fig. 19 and illustrating preservation of a complex scalar attribute field (i.e., color). 

Figs. 22(a-c) are views of a simplified mesh (Figs. 22(b-c)) with 10.000 faces produced from an exemplary arbitrary 
mesh (Fig. 22(a)) with 150,983 faces according to the simplification method of Fig. 19 illustrating preservation of a sca- 

35 lar attribute (radlosity). 

Figs. 23(a-d) are views of a simplified mesh (Figs. 23(c-d)) with 3.000 faces produced from an original arbitrary 
mesh (Figs. 23(a-b)) with 19.458 faces according to the simplification method of Fig. 1 9 Illustrating preservation of over- 
all appearance (including both geometry and attributes). 

Figs. 24(a-d) are views of three exemplary meshes (/W^ with 150 faces in Fig. 24(b); M^^^ with 1000 faces in Fig. 
40 24(c); and M^^^^ with 4000 faces In Fig. 24(d)) out of a sequence of progressive meshes formed according to the sim- 
plification method of Fig. 19 from an example Initial arbitrary mesh M with 13.546 faces (Fig. 24(a)). 

Figs. 25(a-c) are views of exemplary simplified meshes (each with 2000 faces) produced according to variations of 
the simplification method of Fig. 19 (Rg. 25(a) without Edisci Fig. 25(b) with discontinuity curve topology fixed: and Rg. 
25(c) with E^iisc and with discontinuity curve topology changing) Illustrating preservation of the geometry of discontinuity 
45 curves. 

Fig. 26 is a block diagram of a geomorph data structure for representing a geomorph between two meshes of the 
PM representation of Fig. 7 which Is constructed according to the geomorph construction method of Fig. 9(a). 

DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS 

50 

Referring to Fig. 5, an operating environment for an illustrated embodiment of the present invention Is a computer 
system 50 with a computer 52 that comprises at least one high speed processing unit (CPU) 54. In conjunction with a 
memory system 56, an input device 58, and an output device 60. These elements are interconnected by at least one 
bus structure 62. 

55 The illustrated CPU 54 is of familiar design and includes an ALU 64 for performing computations, a collection of 
registers 66 for temporary storage of data and instructions, and a control unit 68 for controlling operation of the system 
50. The CPU 54 may be a processor having any of a variety of architectures Including Alpha from Digital. MIPS from 
MIPS Technology, NEC, IDT. Siemens, and others, x86 from Intel and others, including Cyrix, AMD, and Nexgen, and 
the PowerPC from IBM and Motorola. 
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The memory system 56 generally includes high-speed main memory 70 in the form of a medium such as random 
access memory (RAM) and read only memory (ROM) semiconductor devices, and secondary storage 72 in the form of 
long term storage mediums such as floppy disks, hard disks, tape. CD-ROM. flash memory, etc. and other devices that 
store data using electrical, magnetic, optical or other recording media. The main memory 70 also can include video dis- 

5 play memory for displaying images through a display device. Those skilled in the art will recognize that the memory 56 
can comprise a variety of alternative components having a variety of storage capacities. 

The input and output devices 58. 60 also are farriiliar. The input device 58 can comprise a keyboard, a mouse, a 
physical transducer (e.g., a microphone), etc. The output device 60 can comprise a display, a printer, a transducer (e:g.. 
a speaker), etc. Some devices, such as a network interface or a modem, can be used as input and/or output devices. 

10 As is familiar to those skilled in the art. the computer system 50 further includes an operating system and at least 

one application program. The operating system is the set of software which controls the computer system's operation 
and the allocation of resources. The application program is the set of software that performs a task desired by the user, 
using computer resources made available through the operating system. Both are resident in the illustrated memory 
system 56. 

15 In accordance with the practices of persons skilled in the art of computer programming, the present invention is 

described below with reference to acts and symbolic representations of operations that are performed by computer sys- 
tem 50, unless indicated othenwise. Such acts and operations are sometimes referred to as being computer-executed. 
It will be appreciated tiiat the acts and symbolically represented operations include the manipulation by the CPU 54 of 
electi-ical signals representing data bits which causes a resulting transformation or reduction of the electrical signal rep- 

20 resentation. and the maintenance of data bits at memory locations in memory system 56 to thereby reconfigure or oth- 
erwise alter the computer system's operation, as well as other processing of signals. The memory locations where data 
bits are maintained are physical locations that have particular elect-ical. magnetic, or optical properties corresponding 
to tine data bits. The term "specify" is sometimes used herein to refer to the act of encoding data bits as representations 
of physical objects, activities, properties or characteristics, and relationships. 

25 

Overview of Meshes. 

Referring now to Fig. 6. tine computer system 50 (Fig. 5) utilizes a progressive mesh ("PM") representation to model 
three dimensional objects for graphics imaging as polygonal meshes at varying levels of detail. For simplicity, the PM 

30 representation in the illustrated embodiment operates on ti-iangle meshes (see. discussion in the "Background and 
Summary of the Invention" above). The PM representation of the illustrated embodiment can operate witii more general 
meshes, such as those containing n-sided faces and faces with holes, by first converting the more general mesh into a 
triangle mesh using conventional triangulation processes (e.g., edges are added to subdivide polygonal faces of the 
mesh having more than 3 sides into triangle faces). Alternatively, edge collapse transformations (described below) can 

35 be applied to the sides of polygonal faces having more than three sides to produce a triangle mesh. It should also be 
recognized that the PM representation can be generalized in alternative embodiments of the invention to operate 
directiy with more general meshes (i.e.. without prior triangulation), at the expense of more complex data structures. 

Overview of Progressive Mesh Representation. 

40 

Referring again to Figs. 1 and 2, Hoppe93 (see. Background and Summary of the Invention above) describes a 
mesh optimization method that can be used to approximate an initial mesh /W by a much simpler one. This mesh opti- 
mization method traverses the space of possible meshes (as discussed above with reference to the graph of Fig. 2) by 
successively applying a set of 3 mesh transformations: edge collapse, edge split, and edge swap. 

45 With reference to Fig. 6. the inventor has since discovered that in fact a single one of those transformations, edge 
collapse denoted herein as eco\({Vs.vJ), is sufficient for the effective simplification of a mesh. To illustrate, an edge col- 
lapse ti-ansformation 1 1 0 unifies 2 adjacent vertices Vs 86 and Vf 89 of the mesh 80 into a single vertex 86' to form 
a resulting simpler mesh 112. The vertex v^ 89 and tin e two adjacent faces {Vs,Vf.v^ 100 and {Vs,Vt,Vf} 101 of the original 
mesh 80 vanish in the process. A position is specified for the new unified vertex 86'. 

50 Thus, an initial mesh M==/W" can be simplified (such as by the mesh simplification method described more fully 
below) into a coarser mesh A/f^ by applying a sequence of n successive edge collapse transformations: 

(M^M''}ecol„.j-->' m"'\.. ecolj-^ /w' eco/^-* ■ (5) 

55 The particular sequence of edge collapse transformations must be chosen carefully, since it determines the quality of 
the approximating meshes /W, i<n. Where is the number of vertices in M^, the vertices of mesh /W are labeled 
herein as \/={vj,...,v^q^J. so that vertex Vmo+w./ 'S removed by eco/,. As vertices may have different positions in the 
different meshes, the position of vj in A/f is denoted herein as vj. 

A key observation is that an edge collapse transformation is invertible. The inverse transformation is herein referred 
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to as a vertex split 116. A vertex split transformation, denoted herein as vsplit(Vs,vi,Vf,Vt,A), adds near vertex 86' ^ 
new vertex (i.e., previously removed vertex Vf 89) and two new faces (i.e.. previously removed faces {Vs,VpV^ 100 and 
{Vs,Vt,Vr} 101) according to the two side vertices Vf 87 and 88. (If the edge {v^.vj 92 is a boundary edge, then v^O 
and only one face is added.) The transformation also updates the attributes of the mesh In the neighborhood of the 
5 transformation. This attribute information, denoted by A. includes the positions and Vt of the two affected vertices, 
the discrete attributes df^s.vt.vt} and d^y^.vt.vr} ^ the two new faces, and the scalar attributes of the affected corners 

Referring to Fig. 7. because edge collapse transformations are tnvertible, an arbitrary triangle mesh M therefore- 
can be represented according to the iifustrated embodiment of the im'ention as a data structure 130 containing a base 
vo rnssh record 132 specifying the simple mesh NP (hereafter the "base mesh"), together with a sequence T34 of n vsoHt 
records 136 specifying a sequence of vertex split transformations that reconstruct the arbitrary mesh td fi'om the base 
mesh 

M° vspfitQ-^ vsplitj-^ ... vsplit^j^ {M" = M) (6) 

15 

where the vsplit records are parameterized as vspiit,(s,JiJi,AJ- The data structure {h/P .{vsp}ito...->vsp!it„.i}) 130 is 
referred to herein as a progressive mesh (PM) representation of the arbitrary mesh M- 

A significant property (referred to herein as "completeness") of the vertex split transformation is that a mesh with 
any arbitrary simplicial complex can be constructed from a mesh with a minimal simplicial complex of the same 

20 topological type by a sequence of one or more of the transformations. (The four to one face split transformation used in 
the prior MRA approach discussed above is not complete in this sense because a sequence of these face split trans- 
formations can only construct an approximation to any arbitrary mesh from a minimal mesh of the same topological type 
having subdivision connectivity) Because the vertex split transformation is complete in this sense, any arbitrary mesh 
can be reprented exactly using the illustrated PM representation. Similarly, a set of one or more mesh transformations 

25 also is complete if a mesh having any arbitrary simplicial complex can be constructed from a minimal simplicial com- 
plex of the same topological type by a sequence of transformations from the set. Accordingly, although vertex split 
transformations are specified in the sequence of records in the PM representation of the illustrated embodiment, the 
records in a PM representation can alternatively specify a set of mesh transformations that is complete other than the 
vertex split transformation. For example, a set including the 4-to-1 face split transformation plus a vertex split transfer- 

30 mation is complete and can be specified in the sequence of records in a PM representation of an alternative embodi- 
ment of the invention. 

In the PM representation 130 of the illustrated embodiment, the base mesh record 132 comprises a simplicial com- 
plex table 1 40. a vertex positions table 142, a discrete attributes table 1 44, and a scalar attributes table 146 which con- 
tain information of the tuple M^^(K° ,D° ,S°) that defines the base mesh /W^. The vertex positions table 142 

35 contains mo position records 1 50-1 51 for each vertex of the base mesh /W^ with that vertex's coordinate values (x.yz). 
In the illustrated vertex positions table 142, the position records 150-151 are indexed according to vertex indices asso- 
ciated with the indices of the base mesh {\/P. 

The simplidal complex table 140 contains face records 154-1 55 for each face in the base mesh ^ with the indices 
of that face's vertices {v^Vif, Vf}. This vertex information in the face records explicitly defines each face of the base mesh 

40 A^. and also implicitly defines the edges and corners of the base mesh l\/P. In alternative embodiments, the base mesh 
record 132 can contain information which explicitly defines the edges and corners, such as records containing indices 
of pairs of adjacent vertices to define the edges and records containing indices of vertex index, face index tuples to 
define the corners. In the illustrated simplicial complex table, the face records 154-155 are indexed according to face 
indices associated with the faces of the base mesh a/*. 

45 The discrete attributes table 144 contains records 158-159 with information (i.e.. an attribute value and a face 
index) that defines the discrete attributes associated with the faces of the base mesh h/P. The scalar attributes table 
146 contains records 162-164 with information (i.e.. an attribute value and a vertex index, face index tuple) that define 
scalar attributes associated with corners of the base mesh l\/P. Although illustrated with a single discrete attributes table 
144 and a single scalar attributes table 146. the base mesh record 132 can contain separate attributes tables for each 

50 of multiple different discrete and scalar attributes (e.g.. material identifies, shader function parameters, diffuse color, 
normal, texture coordinates, etc.) of the base mesh 

The vertex split records 1 36 in the sequence 1 34 specify vertex split transformations that reconstruct the arbitrary 
original mesh /Wfrom the base mesh /W^. In general, the information in each of the vertex split records comprises indi- 
ces of the vertices 86, Vf 87 and v,. 88 (Fig. 6); the position coordinates v^" and vp of the vertices 86 and Vf 89 

55 (Fig. 6); the discrete attributes df^ vt,vi} a^td df^ ^t^vr} faces 1 00 and 101 (Fig. 6): and the scalar attributes ^(vs,.)' s^w,.;- 
S(vi,fvs,vt,vt}}' ^{vr,{vs.vt,vr}) of the comers of the faces 100 and 101. In alternative embodiments, the vertex split 
records can specify the vertices Vg, vy, and v^ indirectly, such as by the index of a neighboring face (e.g.. one including 
the vertices and v/) and bits identifying the vertexes from those adjacent that face (e.g., identifying and v, out of 
the face's vertices, and identifying out of the vertices neighboring the face). 
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As an example with reference to Figs. 8(a-d), the example initial artiitrary mesh /Wot Fig. 1(a) (with 12.946 faces) 
. was simplified down to the coarse mesh 1 70 of Fig. 8{a) (with 50 faces) using 6448 edge collapse transformations. 
The PM representation of M (Fig. 1 (a)) consists of a base mesh record specifying f\/P together with a sequence of 
n=6448 vspfit records. From this PM representation, one can extract approximating meshes with any desired number 

5 of faces within +1 by applying to a prefix of the vsplit sequence. For example. Figs. 8(b-d) shows two approximating 
meshes with 200 and 1000 faces out of the progressive meshes sequence. 

In the illustrated embodiment, the data structure of the PM representation 130 described above where the simplicial 
complex table 140 lists face records 154-155 containing the vertex indices of each face is used for storage purposes 
(e.g.. storage of the progressive meshes on the hard disk of the computer system 50 of Fig. 5). At run time, the illus- 

',0 trated embodiment utilizes an edge based data structure for the simplicial complex table 140 to also encode the adja- 
cency of faces. This allows for efficient processing of queries, such as which faces are adjacent to face fj. and which 
faces are adjacent to vertex Vj. Suitable edge based data structures are well known, and include the winged-edge data 
structure described in K. Weiler. Edge-based Data Structures for Solid Modeling in Curved-surface Environments, IEEE 
CG&A5(1) :21-40 (January 1985). 

15 In some alternative embodiments of the invention, the vertex split records 136 can encode information to specify 

the attributes of the mesh both before and after the vertex split transformation is applied. This allows traversal of the 
progressive meshes sequence In both directions. In other words, a given mesh in the progressive mesh sequence can 
be either further refined by applying vertex split transformations specified in subsequent (not yet applied) vertex split 
records, or the mesh can be simplified by reversing the vertex split transformations specified in preceding (previously 

20 applied) vertex split records as desired. At a minimum, the added Information specifies the vertex position in the 
mesh before the vertex split transformation is applied. Other attributes of the faces 102" -107' (Fig. 6) and corners that 
are present before the vertex split transformation is applied also can be encoded in the vertex split records if they are 
changed by the vertex split transformation. 

25 Geomorphs. 

A beneficial property of the vertex split transformation (and its inverse, edge collapse) is that a smooth visual tran- 
sition (a geomorph) can be created between the two meshes and M'*^ in A// vsp//f,— > M'* \ With the assumption that 
the meshes contain no attributes other than vertex positions, the vertex split records 136 (Fig. 7) are each encoded as 



30 



40 



where Sj. Ij. rj are the indices of the vertices v^^, V|j. and Vrj, respectively. (In other words, the vertex split record 136 con- 
35 tains the vertex indices and position values, but not the discrete and scalar attribute values shown In Rg. 7.) A geo- 
morph /W^(a) is created with blend parameter 0 :^ a < 1. such that t\/P(0) looks like A/f' and hPil) looks like M '-^'-in 



fact f\/1^(1)-M '"*"^-by defining a mesh 



M^iaMK'^'.v'^ia)) (7) 



whose connectivity is that of A^"^' and whose vertex positions linearly interpolate from Vsje Af to the split vertices 



45 v/ra; = 



xr/*^=v/ , J ^ (s,.mo+i+l} (8) 



50 

Using such geomorphs, an application can smoothly transition from a mesh A/f to meshes A/f * ' or A//" ' without any 
visible "snapping" of the meshes, by varying the value of a. 

Moreover, since each individual vsplit/ecol transformation can be transitioned smoothly so can the composition of 
any sequence of them. Thus, given any two meshes, a coarser mesh A/f^ and a finer mesh A/. 0 < c < / < n. in the 
55 sequence of meshes A/* ... encoded by the PM representation, a smooth geomorph (\/P(a) can be defined such that 
l\/P(0) looks like and l\/P(1) equals A/. To obtain M^, each vertex vj of A/ is associated with its ancestor in A/T^; the 
index A'^Q) of this ancestor vertex is found by recursively backtracking through the vsplit transformations that led to the 
creation of vj: 
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/ (Sj,^o.i) f3 > J^o+c (9) 

5 

(In practice, this ancestor information A*^ is gathered in a forward fashion as the mesh is refined.) The geomorph t^(a). 
is defined by M'^(a) = (K', V^(a}} to have the connectivity of M* and the vertex positions 



75 

So far, the above discussion has outlined the construction of geomorphs between PM meshes containing only posi- 
tion attributes. In fact, geomorphs can be constructed for meshes containing both disaete and scalar attributes. 

Discrete attributes by their nature cannot be smoothly interpolated. Fortunately, these discrete attributes are asso- 
ciated with faces of the mesh, and the "geometric" geomorphs described above smoothly introduce faces. In particular. 

20 observe that the faces of are a proper subset of the faces of A/, and that those faces of h/f missing from l\/F are 
invisible in 1^(0) because they have been collapsed to degenerate (zero area) triangles. Thus, as d is varied from 0 to 
1 . these triangles grow from zero area triangles in !\/P(0) to their full size in M^(1)=m\ Prior geomorphing schemes 
(such as those described in J. M. Lounsbery, Multiresolution Analysis for Surfaces of Arbitrary Topological Type. PhD 
thesis, Department of Computer Science and Engineering. University of Washington, (1994); Lounsbery-etal94; and 

25 Turk92} define well-behaved (invertible) parametrizations between meshes at different I eve! s-of -detail. Such parametri- 
zations do not permit the construction of geomorphs between meshes with different discrete attributes. In contrast, geo- 
morphs of the PM representation meshes define non-invertible maps from A/ to A^. in which all faces of missing 
from are mapped to edges or vertices of ^f. This mapping makes a smooth visual transition of meshes with discrete 
attributes possible. 

30 Scalar attributes defined on corners also can be smoothly interpolated much like the vertex positions. There is a 

slight complication in that a corner (v.f) present in a mesh M cannot be associated with any "ancestor corner" in a 
coarser mesh if f'ts not a face of M^. The attribute value that the corner (vJ' would have in A^ can be inferred by 
examining the mesh A/f^' in which / is first introduced, locating a neighboring corner (vj'} in A/f"*"' whose attribute value 
is the same, and recursively backtracking from it to a corner in A/f^. If there is no neighboring corner in A/f * ' with an iden- 

35 tical attribute value, then the corner (v,f) has no equivalent in !\/f and its attribute is therefore kept constant through the 
geomorph. 

The interpolating function on the scalar attributes need not be linear: for instance, normals are best interpolated 
over the unit sphere, and colors may be best interpolated in Hue- Saturation -Value ("HSV") space (although, in the illus- 
trated embodiment, colors are interpolated in Red-Green-Blue ("RGB") space for efficiency). 
40 The interpolating function for vertex positions also need not be linear. In some embodiments of the invention for 
example, the vertex positions of the geomorph can be defined as 

v*^ (a) = (a (a) }v'+ (1 -a (a) )v^, 

45 

where the function a(a) = 0.5+0.5sin((a'0.5)n) (i.e., a non-linear function in a as opposed to a linear function such as 
a(a)=a) . This non-linear function a(a) provides interpolation for 0<ct<1, but has a zero valued derivative at 0 and 1. 
This results in a slow-in. slow-out interpolation behavior. 

50 Referring to Fig. 9(a). the illustrated computer system 50 (Fig. 5) performs a method 190 for constructing geo- 

morphs to display smooth transitions between any two progressive meshes in a PM representation. The method 190 
can be implemented as a module of code, which for example forms a component of a software application run on the 
computer system 50 to display 3D graphics. The method 1 90 generally is a preprocess for the geomorph evaluation and 
display method shown in Fig. 9(b). 

55 The method 1 90 begins at steps 192-193 with selecting the coarser mesh and finer mesh A^^ out of successive 
level of detail meshes specified in a PM representation. This selection can be made by the software application itself. 
For example, when transitioning between level -of-detail approximations due to a change in viewing distance, the soft- 
ware application selects the coarser and finer meshes to correspond to the starting and ending level-of-detail approxi- 
mations. Alternatively, the software application can provide user interface controls (e.g., a value entry box, or a list 
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selection box) for selection of the coarser and finer meshes by the computer user Fig. 3. described below, illustrates a 
software system with user interface controls for selecting the coarser and finer meshes. 

With the finer and coarser meshes selected, the computer system 50 creates a geomorph {M'^ {a)={K^ .v'^ {a))) 
with a connectivity (hf) equal to that of the selected finer mesh at step 194. The positions of the vertices of the geo- 

5 morph vary between their position in the coarser mesh to their position in the finer mesh according to the value of the 
blend parameter a. At step 195, the discrete attributes associated with the faces of the selected finer mesh are then 
mapped to the corresponding faces of the geomorph. 

Referring to Fig. 26. the geomorph created by the method 190 preferably is realized as a geomorph data structure* 
200 (with some similarities to that of the base mesh record 132 (Fig. 7)) that can be stored in the memory system 56 of 

10 the illustrated computer system 50 (Fig. 5). The illustrated geomorph data structure 200 comprises a simplicia! complex 

table table 202. a vertex positions V (a)={v , °(a) (a)} table 203. a discrete attributes table 204. and a 

scalar attributes table 205. The simplicia! complex table 202 comprises face records 206-207 representing the faces of 
the geomorph. As in the simplidal complex table 140 of the illustrated PM representation 130 (Fig. 7), the face records 
206-207 encode indices of the three vertices [vj,v^Vi) that define each face. 

75 The vertex positions table 203 comprises vertex position records 208-209 representing the positions of the vertices 
of the geomorph. Since the positions of the vertices of the geomorph are interpolated between the vertex positions in 
the fine and coarse meshes according to the blend parameter a, the vertex position records 208-209 encode these ver- 
tex positions in the fine and coarse meshes. {xf,yf>zf^) and {x/,yf,Zj^. 

The discrete attributes table 204 and the scalar attributes table 205 comprise records 210-213 which represent the 

20 scalar and disaete attribute values of the faces and corners of the geomorph. respectively. The scalar attribute records 
212-213 each encode two scalar attribute values (sf) and (s/) of the corners from both the coarse and fine meshes, for 
interpolating the value of the scalar attributes according to the blend parameter a. 

Referring to Fig. 9(b). the illustrated computer system 50 (Fig. 5) performs a method 200 for evaluating and display- 
ing the geomorphs constructed by the method 190. The method 200 typically evaluates the geomorph at a sequence 

25 of values of the blend parameter a so as to effect a smooth visual transition between the coarse and fine meshes 
selected at steps 192. 193 of the method 190 (Fig. 9(a)). The method 200 thus repeats a loop of steps for each value 
of the blend parameter. 

At step 202 of the method 200. the value of the blend parameter a is selected. Again, this value can be selected by 
the software application or by the computer user. In the case of the software application, a is generally stepped through 

30 a sequence of values that smoothly transition the geomorph between the coarser and finer meshes (e.g., 0, 0.25, 0.5. 
0.75. and 1.0 in the example geomorph shown in Figs. I0{a-j)). For selection by the computer user, the software appli- 
cation provides a user interface control which sets the value of a. Preferably, a sliding control (e.g.. a scroll bar or rotat- 
ing knob type control) is used to permit the user to smoothly vary the value of a. Alternatively, the software application 
can select values in a pre-defined sequence. 

35 With the value of a selected, the computer system 50 then interpolates the vertex positions Vj^{a) of the geomorph 
according to the selected value of a at step 203 as described by the expression (6) above. At step 204, the scalar 
attributes of the geomorph also are interpolated according to the selected value of a as described above. The computer 
system 50 then regenerates and displays a view based on the geomorph at step 205. As indicated at step 206, the 
steps 202-205 are then repeated for other selected values of the blend parameter a. 

40 As an example. Figs. lO(a-d) demonstrate views of an exemplary geomorph constructed according to the illus- 
trated embodiment between two meshes M^(0)= M (with 500 faces) and M (1}=M'*^^ (with 1000 faces) retrieved 
from the PM representation of the example original mesh M shown in Fig. 24(a), which includes the example progres- 
sive meshes shown in Figs. 24(b-d). 

Referring to Fig. 3. a software system 420 according to the illustrated embodiment of the invention utilizes a number 

45 of geomorphs constructed from the PM representation by the methods 190 (Fig. 9(a)) and 220 (Fig. 9(b)) for viewing 
continuously variable level -of -detail approximations of a mesh. The software system 420 comprises a user interface 
422, a graphics application 424. a level of detail approximator 426. and a display driver 428. With the user interface, a 
user of the computer system 50 (Fig. 5) controls the level of detail of a mesh output by the level of detail approximator 
426. The graphics application 424 and display driver 428 then render and display a view of the mesh. 

50 For setting the level of detail of the mesh, the user interface 422 comprises two user interface controls, a D slider 
control 432 and a T slider control 434. The slider controls 432. 434 preferably are implemented as sliding user interface 
controls, such as a scroll bar, but alternatively may be implemented as other user interface controls which allow selec- 
tion of values from a range, such as spin controls and text entry boxes. The D slider control 432 has a single tab. knob 
or button (shown by the outline arrow in Fig. 3) which can be slid by a user along a bar by manipulating an input device 

55 58 of the computer system 50 (Fig. 5) to thereby vary the value of a detail variable D along a range between 0 and 1 . 
The T slider control 434 has multiple tabs, knobs or buttons which likewise can be slid by a user along a bar by manip- 
ulating the input device 58 to thereby vary the values of a set of geomorph complexity variables Tq. T^+j along a 
range between 0 and n, where n is the number of meshes in the PM representation of the mesh. The user interface out- 
puts the detail and geomorph complexity variables D and f-. . ; to the graphics application 424 to control the level 
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of detail of a mesh produced by the level of detail approximator 426. Preferably, the range of the T slider control 434 is 
on a logarithm scale so that the complexity of the geomorphs increases exponentially for a linear movement of the con- 
trol. In some alternative embodiments of the invention, the T slide control 434 can be omitted and the values of the set 
of geomorph complexity variables Tq Tg^j set by the graphics application 424. 

5 The output variables D and To.....Tg^i are in turn passed by the graphics application 424 to the level of detail 

approximator 426. tn the level of detail approximator, the geomorph complexity variables To,.... r^^., determine the com- 
plexities of a set of coarse and fine meshes out of the progressive meshes in a PM representation from which a set of 

geomorphs CP is constructed. The detail variable D selects a geomorph out of the set of geomorphs and the 

value c-i the blend parameter at which to evaluate the geomorph to produce an approximation of the mesh at a desired 

iG leve! ■ e-ail. 

n>3 iavel of detail approximator 426 comprises an interpolator 436. a PM representation block 433. and a geo- 
morphs table 440. The interpolator 436 converts the value of the detail variable D to an index j for a geomorph Gf out 
of the set of geomorphs GP.....G^ and to a value of the blend parameter a. For example, where there are 1 0 geomorphs 
in the set GP.....G^, the interpolator 436 can allocate the range of the detail variable D between 0.0 and 0. 1 to the first 

IS geomorph CP, and calculate the blend parameter for that geomorph as a~ WD . Similarly, the range between 0.1 and 
0.2 is allocated to the second geomorph G^ and the blend parameter for that geomorph calculated as a= 10(0-0. 1) , 
etc. The interpolator 436 can be implemented as a block of code which calculates a linear interpolation of the detail var- 
iable D to a selected geomorph 0 and blend parameter a. Alternatively, the interpolator 436 is implemented as a took 
up table which maps the detail variable D to the selected geomorph d and blend parameter a. 

20 The PM representation block 438 is a PM representation data structure, such as the data structure 130 shown in 
Fig. 7. of the mesh being approximated. The geomorphs table 440 is an ordered list of geomorph blocks 441-443 for 
the geomorphs GP,...,G^. Each of the geomorph blocks 441-443 is a geomorph data structure such as the geomorph 

data structure 200 shown in Fig. 26. The level of detail approximator constructs the geomorphs CP stored as 

blocks 441-443 from the PM representation stored as block 438 according to the geomorph construction method 190 

25 of Fig. 9(a). For each of the geomorphs O, the values of the geomorph complexity variables V and T?*' specify the 
coarse and fine meshes M^^ and /W^'"^' out of the progressive meshes specified in the PM representation from which 
the geomorph is constructed. For example, the geomorph complexity variables 7^ and V specify the coarse and fine 
mesh h/T^ and for the geomorph GP out of the progressive meshes h/P,...,t^ specified in the PM representation. 
In the illustrated system 420. the geomorph complexity variables Tq 7^^, specify the number of the mesh in 

20 the progressive meshes sequence NP. Alternatively, the geomorph complexity variables To,..., Tg^^ can specify 

the number of faces or number of vertices of the fine and coarse meshes of the set of geomorphs {in which case the T 
-.!ider control 434 has a range from a minimum to a maximum number of the faces or vertices in the PM representation). 

After constructing the set of geomorphs respresented in the geomorphs table 440 based on the geomorph com- 
plexity variables Tq 7^+;, the level of detail approximator 426' evaluates the geomorph according to the geomorph 

35 evaluation method 220 (Fig. 9(b)) based on the interpolated values for desired geomorph Q and blend parameter a. 
This produces approximation of the mesh at a desired level of detail which the level of detail approximator 426 outputs 
to the graphics application 424. The graphics application 424 then renders an image of the approximating mesh using 
conventional mesh rendering techniques, and outputs the image to the display driver 428 for display on an output device 
60 of the computer system 50 (Fig. 5). 

40 

Progressive transmission. 

With reference to Fig. 1 1 . a system 230 according to the illustrated embodiment of the invention utilizes the PM rep- 
resentation for progressive transmission of three dimensional graphics models at multiple levels-of -detail. The system 

45 230 comprises a transmitting computer 232 such as (a network or file server) and a receiving computer 233 such as (a 
client computer station or terminal) which are linked via a communications link 234. These computers 232-233 have the 
architecture of the computer system 50 shown in Fig. 5. The communications link 234 in the illustrated progressive 
transmission system 230 comprises modems 236-237 and a telephone line 238, but alternatively can be realized as a 
local or wide area computer network (including public and private switched networks, commercial online services, the 

50 internet and the like), a broadcast data networK an infra-red or radio frequency link or other communications technolo- 
gies. The transmitting computer 232 stores a PM representation of an arbitrary mesh M in a database 240 of three 
dimensional models, and runs a progressive transmission software application that implements a transmitting process 
244 (Fig. 12(a)) for transmitting a PM representation in the database 240 to the receiving computer 233 on the commu- 
nications link 234. The receiving computer 233 runs a progressive transmission software application that implements a 

55 receiving process 246 (Fig. 12(b)) for receiving the PM representation from the communications link 234 and rendering 
views of the mesh at progressively finer levels of detail. 

Referring now to Fig. 12(a), according to the progressive transmission method 244. the transmitting computer 232 
(Fig. 1 1) first transmits the base mesh t\/P of the PM representation (e g . as the base mesh record 132 of Fig. 7 or as 
a conventional uni -resolution format), followed by the stream 134 (Fig. 7) of the vertex split vsp\\t\ records 136 (Fig. 7). 
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Referring to Fig. 12(b). the receiving process 246 incrementally rebuilds the arbitrary mesh /W specif ied by the PM 
representation as the vertex split records arrive, and animates the view of the changing mesh. In the illustrate receiving 
process 246. the changes to the mesh are geomorphed to avoid visual discontinuities. The original mesh M is recov- 
ered exactly after all n vertex split records in the PM representation are received, since PM is a lossless representation. 

5 At step 254 of the illustrated receiving process 246. the receiving computer 233 (Rg. 11) first receives the base 

mesh /W^ record 132 (Fig. 7) transmitted from the transmitting connputer 232 (Fig. 1 1) at step 250 of process 244. The 
receiving computer 233 then constructs and displays a view of the base mesh at step 255. 

Next. in a loop of steps 256-259, the receiving computer 232 incrementally reconstructs the mesh /Wand interac- 
tively displays a view of the mesh. At step 256 in each iteration of the loop, the receiving computer 233 receives a next 

10 group cf vspiit records 136 (Fig. 7) transmitted from the transmitting computer 232 at step 251 of process 244. Since 
the transmitting conputer 232 transmits the vspiit records continuously, the receiving computer 233 of the illustrated 
embodiment includes an input buffer which temporarily stores vertex split records transmitted during the constructing 
and displaying steps 255. 257-258 until the receiving computer is ready to process them. 

At step 257. the receiving computer 233 incrementally refines the mesh to a current incremental mesh by applying 

15 the group of vspiit records received at step 256 to a previous incremental mesh. In the first iteration of the loop, the pre- 
vious incremental mesh is the base mesh from step 255. In subsequent iterations of the loop, the previous incremental 
mesh is the current incremental mesh from the previous iteration of the loop. At step 258. the receiving computer 233 
then constructs a geomorph from the previous incremental mesh to the current incremental mesh, and displays a visu- 
ally smooth transition between the incremental meshes using the geomorph. The step 258 can optionally be omitted. 

20 and the mesh constructed at step 257 instead displayed. 

The receiving process preferably balances computation between the progressive reconstruction of the mesh /Wand 
interactive display by varying the number of vertex split records received at the step 256 in each iteration of the loop 
256-259. In the presence of a slow communication line, a simple strategy is to display the current mesh whenever the 
input buffer is found to be empty (i.e., vspiit records are continuously applied at step 257 until the input buffer is 

25 exhausted, then the geomorph is constructed and displayed as the input buffer is replenished before repeating in a next 
iteration of the loop). For a fast communication line (i.e.. where transmission of the vspiit record stream 134 (Fig. 7) 
takes less time then constructing and displaying geomorphs from the base mesh to more than one incremental mesh 
out of the progressive mesh sequence), an alternative strategy is to display meshes whose complexities increase expo- 
nentially (i.e., a number p of vspiit records received at step 256 in each iteration of the loop increases exponentially). 

30 For fast communication tines, the step 258 of constructing and displaying a geomorph from the preceding mesh is sub- 
stituted with displaying the mesh from step 257. 

Wlesh compression. 

35 The PM representation of the illustrated embodiment also provides a space-efficient representation for storing 
meshes. The PM representation encodes not only the initial mesh M. but also a continuous resolution family of meshes, 
in a space competitive with that of a compressed uniresolution mesh. First, the size of the PM representation is linear 
on the size of the initial mesh l\/r since the number n of vspiit records is less than the number mp+n of vertices in A^. 
More importantly, because a vertex split is a local transformation on the surface, one can expect significant coherence 

40 in surface attributes before and after each transformation. The PM representation of the illustrated embodiment takes 
advantage of this coherence by encoding the vertex split records with predictive and delta encoding schemes. 

In particular, with reference to Fig. 12, the vertex positions vj*^ (i.e.. the position of vertex 272) and Vmo+/+j'*' 
(i.e.. the position of vertex 273) can be predicted from vj (i.e.. the position of vertex 270) in each vertex split vsplitj 
transformation 276 between mesh A/f 278 and mesh /l^*' 279. That is. the positions of vertices 272-273 is expected to 

45 be near the position of vertex 270. Thus, the illustrated computer system 50 (Fig. 5) encodes the vertex positions in 
each vspiit; record 136 (Fig. 7) as the difference or delta from the vertex position vj (i.e.. 

50 

which requires fewer bits to encode for a given precision than the full coordinates (x,y.z) of vertex positions vj^ ' and 
^mO+/+/'*^- Preferably, these position differences or deltas are encoded in the vertex split records with a variable length 
delta encoding scheme, e.g.. variable length Huffman codes. Suitable variable length codes including Huffman codes 
are described in M. Deering. Geometry Compression, 1995 Computer Graphics Proceedings 13-20 [hereafter "Deer- 
55 ing"*]. 

In the illustrated embodiment, the number of bits needed to delta encode the vertex positions is further reduced by 
exploiting a property of the mesh simplification method (Fig. 19) that for the collapse of each edge {vJ^Kv^o+i+iJ 92 
(Fig. 6). the method considers three starting points for the vertex vj 86 in the resulting mesh: namely. 
{vj* lA^J^^+^mO+uiy^}- Depending on the starting point chosen by the method, the positions {vj"^ ^'^mo^u i) 
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are delta-encoded as either position deltas (vj* ^-vJy^o+i^r^J} starting positions vj"^^ or v^o+/+ 1- or as position 
deltas {((vj^^+v^o^i^ i)/2)'Vs/,(vJ''^ -Vmo^,-^iy2] for starting position r^s,'^ Vv^o+/+ ;)^- The vertex split records there- 
fore encode the choice of the starting position, then the appropriate pair of position deltas. Since each of the four posi- 
tion delta tend to have different value ranges, the four position deltas preferably are encoded, with separate Huffman 
5 code tables adjusted to those value ranges. 

In a further alternative PM representation, the construction algorithm can simply select 
Vs/e/'v^r'. v^()w+j.(v's/*'+v^o+/+ J/^i- This degrades the accuracy of the simplified base mesh, but allows the posi- 
tions (vJ*\v^o+i+ 1} ^° encoded with even fewer bits in the vertex split records (e.g.. the choice of the position vj- 
out of the set of positions {vJ*\v^^o^i^ i-i^s!'' ^^v^o^j^i)^} and then either the position delta v^^^i^^-vj for 

^ SI ^ 3J. * 

or the position delta vj*^-vj for 

J5 

or the position delta {vj^'^ -v^o^j^ij/2 for 

20 



25 Further, since only a small set of vertices 282-287 is adjacent to the vertex v^i 270 in the mesh l\/f 278. a small 
number of bits can be used to specify the vertices V/y 282 and v„ 283 out of the vertices 282-287 adjacent to vertex v^j 
270. Rather than encode indices (hereafter "full vertex indices") of vertices 282 and 283 in the vspiit■^ record 136 
(Fig. 7) to uniquely distinguish them out of the set of all mo+n vertices in the original mesh (which requires more 
bits), the illustrated computer system 50 encodes indices (hereafter "adjacent vertex indices") in the vspfit\ record 136 

30 indicating which out of the set of adjacent vertices 282-287 are the vertices v/, 282 and 283 (such as assigning adja- 
cent vertex indices to the adjacent vertices in ascending order of their full vertex indices). For the illustrated vertex split 
transformation 276. the vertices Vf^ 282 and v„- 283 can then be encoded in 3 bits each (which is sufficient to uniquely 
specify the vertices out of the six possible adjacent vertices). By contrast, even a simple mesh A/J" with 1 .000 vertices 
requires at least 10 bit full vertex indices to uniquely specify each vertex of the mesh. 

35 Additionally, the discrete atti-ibutes (e.g.. material identifiers) d^ys.vt.vi} '^{vs.vt.vr} the faces 290-291 introduced 
by the \/$plit\ transformation 276 in mesh Af"*' 279 can often be predicted from that of adjacent faces 294-297 in /W 278 
using only a few control bits. In tine illustrated embodiment, for example, the conti-ol bits 00, 01 , and 1 1 indicate that the 
discrete attributes of a newly inti-oduced face is either equal to that of the adjoining face (e.g.. faces 294. 296) having 
v/*^ as a vertex, equal to that of the adjoining face (e.g., faces 295, 297) having vj*^ as a vertex, or different from botin 

40 adjoining faces. When the discrete attribute of a newly infroduced face is equal to that of an adjoining face, the control 
bits 00 or 01 suffice to specify that discrete attribute. Where the discrete attribute is different from that of both adjoining 
faces, the control bits 1 1 are followed by a value fully specifying the discrete attribute. Thus, in most cases, the vsplit; 
record 136 can encode tiie discrete attributes such as the material identifier of Uie newly introduced faces in only two 
bits each. 

45 Scalar attributes of newly introduced corners 301-304 in A//"^ ^ 279 can similarly be predicted from neighboring cor- 
ners 305-308 in fl/f 279. Thus, in the illustrated emtxxJiment. these scalar attributes also can be encoded using one or 
more control bits to indicate equality with a neighboring corner or a different scalar ath-ibute. For example, in the illus- 
trate embodiment, a scalar attribute associated with the newly introduced corner 301 is encoded in tiie vspliti record 
136 (Fig. 7) with a control bit 0 to indicate tiie scalar atti-ibute is equal to that of the neighboring corner 306. Whereas. 

50 encoding with a control bit 1 followed by the value of the scalar attribute indicates a different scalar attribute. Preferably, 
in this latter case, the value is encoded by a variable length delta encoding as the difference from the scalar atti-ibute of 
the neighboring corner 306 (which in at least some cases save some additional bits). 

As a result of the above encoding scheme of the illustrated embodiment, the size of a carefully designed PM rep- 
resentation should be at least competitive with that obtained from other prior methods for compressing uni-resolution 

55 meshes. 

Selective refinement. 

With reference to Figs. 13-17. the PM representation 130 (Fig. 7) of the illustrated embodiment also supports selec- 
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tive refinement, whereby detail is added to the model only in desired areas. In general, the illustrated embodiment of 
the invention performs selective refinement by selectively applying only a subset of the vertex split transformations 
specified in the PM representation that refine the mesh in desired areas, such as the surface of the mesh within a view 
frustum (i.e.. the portion of the mesh that is within a view of the mesh currently being displayed). 

5 Referring now to Fig. 14. a first selective refinement method 320 utilizes a callback function, REFINE(i/). to deter- 

mine which vertex split transformations in the PM representation to apply in selectively refining an initial coarse mesh 
yp. The REFINE{ v) function returns a Boolean value indicating whether the neighborhood of the mesh about v should 
be further refined. As an example, to obtain selective refinement of the mesh within a view frustum (i.e., the portion of 
the mesh within a currently displayed view of the mesh), the REFiNE(v) function is defined to be true if either v (e.g.. 

\o vertex 270 of Fig. 12) or any of its neighboring vertices (e.g. vertices 282-287 of Fig. 12) lies within the frustum. In 
the illustrated embodiment, the REFINE(v) function is supplied by a software application which interactively displays 
views of the mesh. 

The first selective refinement method 320 begins at step 322 by constructing an initial mesh M^. with (?<C</7-7, out 
of the sequence of progressive meshes. /W^....,/Vf'. specified by the PM representation 130 (Fig. 7). The initial mesh M^ 
\5 is constructed by applying the vertex split records vsp\\t\ 136 (Fig. 7). for all /<C if any, to the base mesh h/P. 

The first selective refinement method 320 then comprises a loop of steps 323-237. In the loop, the process 320 

selectively refines the initial mesh b/F by iterating through the remaining vertex split records ^vspWc vsplitn-i} 136 as 

before, but only performing the vsplitjiSiJ,; r^A,) transformation at step 326 if: (1 ) all three vertices fv^,. v^, vj are present 
in the mesh (step 324), and (2) REFINE(Vs/) evaluates to TRUE (step 325). (A vertex vj is absent from the mesh at step 
20 324 if the prior vertex split that would have introduced it. vsplitj.fj^o-i^ was not performed due to the above conditions of 
steps 324-325.) 

After the loop 323-327 is repeated for all the vertex split records vspliti 136. C<i<n. the mesh has been selectively 
refined such that additional detail is added to the initial mesh in areas where more detail is desired (e.g.. within the 
view frustum) while other areas remain coarse. At step 328, the process can then display a view of the selectively 

25 refined mesh. As needed to avoid the popping effect, the process 320 can construct and display geomorphs (e.g., using 
process 190 of Fig. 9) between the initial mesh and the selectively refined mesh. 

With reference to Fig. 16(a). a first example mesh modeling a three dimensional terrain and selectively refined by 
the method 320 (Fig. 14) has additional detail within a view frustum currently being displayed by the software applica- 
tion running on the computer system 50 (Fig. 5). For ease of illustration, only the first 10.000 (out of 33.844) vertex split 

30 transformations in the PM representation of the terrain model were considered for selective refinement (to keep the 
mesh from becoming too dense to be perceptible). 

Referring to Fig. 15. a modified selective refinement method 320' permits more vertex split transformations to be 
applied near the boundaries of the localized area. A drawback of the method 320 (Fig. 1 4) is that a vertex v^i within the 
view frustum 332 (Figs. 16(a-b)) may fail to be split because its expected neighbor or v>/ lies just outside the frustum 

35 and was not previously aeated. This is remedied in the modified method 320' by using a less stringent version of the 
condition in step 324 (Fig. 14). In a modified condition of step 324'. the closest living ancestor of a vertex vj is defined 
to be the vertex with index 



40 A' (j } = I j, if exists in the mesh 

I A' (Sj^^o-i) ^ otherwise (11) 

The modified condition of step 324' is that: A'(s,)=Si (i.e., v^y is present in the mesh), and the vertices i/^^a; and v^-^^fj 
45 are both adjacent to v^-, in the mesh. As when constructing the geomorphs, the ancestor information A' is carried effi- 
ciently as the vspUt records are parsed in the illustrated embodiment. If the conditions of both steps 324" and 325 are 
satisfied. vspfit(s„A'(IJ'A'(ri),Ai) is applied to the mesh at step 326 as in the method 320 (Fig. 14). The remaining steps 
322, 323. 327 and 328 in the modified selective refinement method 320" are the same as in the first selective refinement 
method 320. 

50 Fig. 16(b) demonstrates a second example selectively refined mesh which has been selectively refined by the mod- 
ified method 320' (Fig. 15) from the same PM representation of a terrain model as the first example selectively refined 
mesh 330 of Fig. 16(a). Again, for convenience of illustration, only the first 10,000 vertex split transformations (out of 
33.844 vertex split transformations) of the PM representation were considered by the selective refinement method. 
Since the more lenient closest ancestor condition of step 324' allows more of the vertex split records {vsplitc vspHtn. 

55 136 to be applied, tiie second example selectively refined mesh has much more detail within the view frustum than 
the first example selectively refined mesh (i.e.. 12,169 faces in the second example mesh shown in Fig. 16(b) versus 
9,462 faces in the first example mesh shown in Fig. 16(a)). 

Referring to Fig. 17. a further drawback to the selective refinement methods 320 and 320' described above is that 
the above-described REFlNE(v) function can still add a lot of detail to the selectively refined meshes shown in Figs. 
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16(a-b) that have little or no effect on the currently displayed view of the mesh. For example, the above-described 
REFINE(v) function yields a true result for vertex split transformation on a vertex within the view frustum, but far from 
the viewer. Such details add little to the displayed view, but add significantly to the rendering time of the view. Substitut- 
ing a modified REFINE(v') method 340 improves the above described selective refinement methods 320 and 320' by 

5 concentrating refinement near silhouette edges and near the viewer. 

In a first step 342 of the modified REFINE(i/) method 340. the method 340 calculates a signed projected screen 
area [a/: f € F^} of each of the faces adjacent to the vertex v {le.. the area taken by the face in the cunrently displayed 
view). The modified REFINE(v) method 340 then evaluates to or returns the Boolean value true at step 346 (i.e.. to step - 
325 of the selective refinement methods 320 or 320'). if: (1) any face / £ lies within the view frustum (step 343), and 

10 either (2a) the signs of the projected display areas a/ of the laces are not all equal (indicating thai v lies near a silhouette 
edge) (step 344) or (2b) the sum of the projected saeen areas i^f^Fv^f) greater than a predetermined screen area 
threshold (e.g.. 0.1 6^ units where the image has unit area). Otherwise the modified REFINE(v) method 340 returns 
false at step 347 (to step 325 of the selective refinement methods 320 or 320'). 

Referring to Figs. 18(a-b). a third example selectively refined mesh (shown in Figs. 18(a-b)) is produced by the 

15 selective refinement method 320' with the modified REFINE{»/) method 340 from the same PM representation of a ter- 
rain model as the first and second example meshes shown in Figs. 16(a-b). All 33.844 vertex split transformations were 
considered by this modified selective refinement method in this third example. Despite considering many more vertex 
split transformations, the third example mesh (Figs. 18(a-b)) has far fewer faces (i.e., 7.438 faces) than both the first 
and second example meshes (i.e.. 9.462 and 12.169 faces) (Figs. I6(a-b)). while providing refinement of visually sig- 

20 nificant details (i.e., those within the view frustum, near silhouette regions, and near the viewer) substantially equal to 
that of the second example mesh (Fig. 16(b)). As can be seen by the overhead view of the third example selectively 
refined mesh shown in Fig. 18(b), with the REFINE(v) method 340 (which takes into account the view frustum, silhou- 
ette regions and screen size of faces), the selective refinement process 320' saves complexity of the resulting selec- 
tively refined mesh by avoiding refinement in areas within the view frustum that do not contribute significantly to the view 

25 being displayed. 

A further alternative selective refinement method is one that takes into account the visibility of the PM representa- 
tion's vertex split transformations. Although the vertex of a vertex split transformation lies within the view frustum, it may 
still not be currently visible to the viewer if occluded or positioned behind another portion of the surface or a different 
object entirely For example, vertices on the far side of a ridge on the terrain model are not visible to the viewer, even If 

30 they are within the view frustum. For this alternative selective refinement method, the REFINE(\/) function is further 
modified to return a negative or false result if the vertex is not visible. This results in an even simpler seiectively refined 
mesh with a substantially equal quality of appearance in its currently visible areas. 

The above described selective refinement methods 320. 320* and 340 also can be beneficially applied to efficiently 
transmitting view -dependent models over low-bandwidth communication lines. As the receiver's view changes over 

35 time, the transmitting process (e.g., such as the transmitting process 244 of Fig. 12(a)) utilizes the above described 
selective refinement conditions (e.g., steps 324 or 324' along with step 325 or step 325 as modified by method 340) to 
select and transmit only vertex split transformation records vspW, 136 within a currently viewed area of the mesh. As 
the view changes, the transmitting process further transmits any not yet sent vertex split records 136 for the changed 
view. Specifically at each time frame, the transmitting process need only transmit those vertex split transformation 
■ 40 records for which the REFINE(v) method evaluates to true and which were not transmitted in earlier time frames. 

Constructing the PM representation. 

With reference to Fig. 1 9, a mesh simplification and PM construction method 380 constructs the PM representation 
45 1 30 (Fig. 7) of an arbitrary mesh M by first selecting a sequence of edge collapses that transform M=M" into a simpli- 
fied base mesh M^. A sequence of vertex split transformations that is the inverse of the selected edge collapses is then 
encoded with the base mesh /l^ as a PM representation of the arbitrary mesh M. The quality of the intermediate 
approximations or progressive meshes l\/f, i<n specified by the resulting PM representation depends largely on appro- 
priately selecting which edges to collapse and what attributes to assign to the affected neighborhoods (e.g.. the vertex 
50 positions vj). 

For use in appropriately selecting the edge collapse transformations in the illustrated PM construction method 380. 
an explicit energy metric E(M) is defined to measure the accuracy of simplified meshes M=(KMD,S} with respect to 
the original mesh M. This energy metric has the following form: 



55 E(M) = E^^JM) + E,p„.„g(M) + E^^^^/M) + E ^,,JM) (12) 

The first two terms. Efji^^M) and E^^„g(M) are identical to terms of an energy metric for geometry preservation 
used in the mesh optimization method described in Hoppe93. The next two terms. EscaSaA^) Efjisc(f^. of E(M) pre- 
serve attributes associated with M other than geometry alone. As described more fully below, the term E^j^/M) meas- 
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ures the accuracy of the scalar attributes of the simplified mesh M, while the term E^/^cW measures the geometric 
accuracy of the discontinuity curves (defined below and illustrated with yellow lines in Figs. 8(a-c). lO(a-e). 23 (a.d). 
24(a-d) and 25(a-c)) of the simplified mesh M. 

The PM construction method 380 performs mesh simplification by modifying the mesh M starting from M while min- 
5 imizing the energy metric, E(M). More specifically, the method applies minimization of the energy metric to select suc- 
cessive modifications, i.e.. edge collapse transformations, to simplify the mesh to a base mesh M° while best 
preserving the mesh's appearance. The base mesh together with a sequence of vertex split transformations which 
is the inverse of the simplifying succession of edge collapse transformations becomes the PM representation of the 
original mesh M. 

10 The method 380 begins at step 382 with calculating an estimated energy cost A6 according to the energy metric 
E(M) of a set of all candidate edge collapse transformations. Edge collapse transformations of the edges of the mesh 
M must meet some local conditions to be included in the set of candidate edge collapse transformations. In the illus- 
trated method 380. these local conditions Include a maximum dihedral angle restriction and a manifold preservation 
restriction as described in Hoppe93. The nriaximum dihedral angle restriction disallows any edge collapse transfer ma- 

75 tlon if the maximum dihedral angle of edges in the neighborhood after an edge collapse exceeds a threshold angle 
(acos{- 1/3)= 109.471 degrees in the illustrate method), so as to avoid surface self- intersections. For each candidate 
edge collapse K -> K'. the method 380 calculates its cost AE = £^-£'^by solving a continuous optimization 

= min^s E^iJV) + E .^^^^(V) + E^^^(V,S) + £^,^(V) (13) 

20 

over both the vertex positions V and the scalar attributes S of the mesh with connectivity K'. 

At step 383. the candidate edge collapse transformations are then organized into a priority queue in ascending 
order of their estimated energy cost a£ (i.e.. the edge collapse transformation with the lowest estimated energy cost 
a5 is placed first in order of priority in the priority queue). 

25 The method 380 simplifies the mesh M into the base mesh l\/f having a resolution or level of detail selected at step 
384. i.e. to within ±1 of a selected number of faces for the base mesh This number can be selected by the computer 
user using a user interface control (e.g.. a numeral entry box. scroll bar or like sliding control, etc.) which is provided by 
the software application implementing the method 380. Alternatively, the software application can set the number of 
faces. In the illustrated method 380, the selected number of faces cannot be less than a minimum number of faces for 

30 meshes of the same topological type as the original arbitrary mesh M. 

The method 380 then repeats a loop of steps 385-389 until the mesh has been simplified to the number of faces 
selected in step 384 or there are no more candidate edge collapses. In each iteration of the loop, the method 380 first 
applies the highest priority edge collapse transformation {ecof({v^ vj)) in the priority queue to the mesh M at step 385. 
At step 386. the method 380 stores the vertex split transformation vsplit(v^vi,Vf,Vi,A) which is the inverse of the edge 

35 collapse transformation performed at step 385. (The set of the vertex split transformations stored at step 386 are later 
encoded in reverse order at step 390 as the sequence of vertex split records 134 (Fig. 7) in the PM representation.) 

At step 387, the method 380 compares the number of faces in the mesh M resulting from the edge collapse trans- 
formation to the number of faces selected for the base mesh t\/P. As long as the number of faces in M is greater than 
the selected number of faces of the base mesh l\/P and there remain candidate edge collapse transformations in the 

40 priority queue, the method 380 continues iterating through the loop of steps 385-389. Othenwise. the method 380 exits 
the loop. 

If continuing another iteration of the loop, the method 380 at step 388 recalculates the energy cost AE of all candi- 
date edge collapse transformations in the neighborhood of the edge collapse transformation performed at step 385 in 
the current iteration of the loop. For example, if the edge collapse transformation 1 10 of Rg. 6 is performed at step 385. 
45 the method 380 recalculates the estimated energy cost a6 of all candidate edge collapse transformations in the priority 
queue for the edges of faces 102'-107'. The method 380 then reorders these edge collapse transformations in the pri- 
ority queue according to their newly calculated energy cost AE. With the reordered priority queue, the method 380 
repeats the loop 385-389. 

After exiting the loop at step 387 when the mesh M has been reduced to the selected number of faces, the method 
50 has produced a continuous resolution family of meshes consisting of the base mesh !\/P (e.g., the mesh M resulting 
from the sequence of edge collapse transformations performed at step 385 in the loop) and a sequence of progressive 
meshes defined by the stored vertex split operations. At step 390. the method 380 encodes the base mesh f\/P and the 
sequence of stored vertex split transformations to form the PM representation 130 as discussed above. 

In an alternative variation of the method 380. the Step 384 of selecting the number of faces of the tjase mesh is 
55 omitted. Instead, the loop of steps 385-389 is simply repeated until the priority queue contains no more legal edge col- 
lapse transformations at the comparison step 387. The mesh M is thus reduced to its simplest form (within the condi- 
tions imposed on candidate edge collapse transformations as described above for step 382). 

With reference to Fig. 20. in comparison to the mesh optimization method described in Hoppe93 (discussed in the 
"Background and summary of the Invention" above), the illustrated PM construction method 380 has a nunnber of 
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advantages for mesh simplification. A key difference is that the illustrated PM construction method 380 utilizes the edge 
collapse transformation alone to simplify the arbitrary mesh. (The mesh optimization method described in Hoppe93 uti- 
lizes a set of three possible mesh transformations, edge collapse, edge split, and edge swap, selected at random.) Con- 
sidering only edge collapses simplifies the implementation and improves performance of the illustrated PM construction 

5 method 380. but more importantly gives rise to the illustrated PM representation 130 (Fig. 7). 

As demonstrated by an accuracy versus conciseness graph 400, another key difference is the priority queue uti- 
lized in the illustrated PM construction method 380 for selecting the edge collapse transformations that are applied to 
the successive level-of-detail approximations. This allows the illustrated PM construction method 380 to produce better - 
approximations to the original mesh Mat levels -of -detail intermediaie the original mesh /Wand the base mesh /Vf^ (e.g.. 

ic along a path 402). By contrast, the mesh optimization scheme described in Hopp633 randomly attempts successive 
mesh transformations, and usually achieves poorer approximations along the paths 34-36 (Fig. 2). 

As a further consequence of the priority queue selection in the illustrated PM construction method 380. the need 
for the representation constant Crep (as well as the representation energy term Erep(M) is eliminated. As described in 
the "Background and Summary of the invention" above, varying the value of the representation constant c^ep permits a 

15 rough selection of the resolution of the approximating mesh (e.g.. meshes M^-M^ of Fig. 2 and exemplary meshes 
shown in Figs. 1(b-d)) produced by the mesh optimization method described in Hoppe93. The illustrated PM construc- 
tion method 380 instead allows the resolution of the base mesh to be explicitly selected (to within ±1 faces). Addi- 
tionally, as opposed to the single mesh M^,, M^.. or (Fig. 2) produced by the Hoppe93 mesh optimization per selected 
value of the representation constant Crep, the illustrated PM construction method 380 produces a continuous-resolution 

20 family of meshes per run. 

Referring again to Figs. 8(a-d) for example, the meshes shown in Figs. 8(a<l) are examples of a few out of a con- 
tinuous resolution family of meshes in a PM representation produced by the illustrated PM construction method 380 
(Fig. 19) to approximate the example original arbitrary mesh M{F\q. 1(a)). By contrast, the Hoppe93 mesh optimization 
produces a single one of the exemplary meshes shown in Figs. 1 (b-d) to approximate the mesh M (Fig. 1(a)) per run of 

25 the method for a selected value of the representation constant Crep- 

Preserving surface geometry 

Referring again to Fig. 19, when calculating the estimated energy cost a£ at steps 382 and 388. the illustrated PM 
30 construction method 380 records the geometry of the original mesh Mby sampling from it a set of points X. At a mini- 
mum, the illustrated PM construction method 380 samples a point at each vertex of M The software application imple- 
menting the illustrated method 380 also includes ~n additional user option which, if selected by the user, samples 
additional points randomly over the surface of M, 

After sampling the set of points X, the method 380 evaluates terms of the estimated energy cost in expression (13) 
35 above. The energy terms Ejist(M) and Espnngi^) f^at expression are defined as described in Hoppe93 and discussed 
in the "Background and Summary of the Invention" above. For a mesh of fixed connectivity, the illustrated method 380 
for optimizing the vertex positions to minimize f^c/zs/W+^spring^W closely follows that described in Hoppe93. Evaluating 
Ecjist(V) involves computing the distance of each point x, in the set of points X to the mesh M. Each of these distances 
is itself a minimization problem 

40 

d'(x,,<j>,(\K\)) =nii2i^,^|«l II AT, - 4>^(b,) p (14) 

45 where the unknown bj is the parameterization of the projection of Xj on the mesh. In the illustrated method 380, the non- 
linear minimization of E^jst(V)+Espring(^) 's performed using an iterative procedure alternating between two steps. In 
the first step, for fixed vertex positions V, the method 380 computes the optimal parametrizations B={bi i>|x|i by pro- 
jecting the points X onto the mesh. In the second step, for fixed parametrizations B, the method 380 computes the opti- 
mal vertex positions V by solving a sparse linear least-squares problem. 

50 When considering eco!({v^vJ), the illustrated method 380 optimizes only one vertex position, vj, by performing 
three different optimizations with different starting points, i.e.. 

55 

for a~{0, 1/2, 1}, and accepts the best one. 

Unlike the mesh optimization method described in Hoppe93 which defines a global spring constant k for E^^^g. 
the illustrated method 380 adapts k each time an edge collapse transformation is considered. Intuitively, the spring 
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energy is most important when few points project onto a neighborhood of faces, since in this case finding the vertex 
positions minimizing EcSsii^) n^ay be an under-constrained problem. Thus, for each edge collapse transformation con- 
sidered, the method 380 sets k as a function of the ratio of the number of points to the number of faces in the edge col- 
lapse transformation's neighborhood. As illustrated in Fig. 6, the neighborhood of an edge collapse ti'ansformation 110 
5 is the set of faces 100-107. Using C notation, the method 380 sets k := r<4 ? 70"^ . r<8 ? 10'"^ : 10'^ where r is the 
ratio of the number of points to faces in the neighborhood. 

With this adaptive scheme, the influence of Espnng(M) decreases gradually and adaptively as the mesh is simpli- 
fied, and the expensive schedule of decreasing spring constants used in the mesh optimization method described in 
Hoppe93 is no longer needed. 

Preserving scalar attributes scalar)- 

As described in the discussion of triangle meshes in the "Background and Summary of the Invention" above, piece- 
wise continuous scalar fields are represented in the illustrated embodiment by defining scalar attributes S at the mesh 
15 corners. More specifically, the original mesh Mgenerally has at each vertex not only a position Vy e but also a sca- 
lar atti-ibute Vy e R'^. In addition to preserving the geometry of the original mesh M the estimated energy cost function 
used in the illustrated PM construction method 380 additionally operates to preserve these scalar attributes of the orig- 
inal mesh /Win the progressive meshes that the method 380 consb-ucts, 

20 Optimizing scalar attributes at vertices. 

To capture scalar atti-ibutes of the original mesh M the illustrated PM construction method 380 also samples at 
each point X; g X the attribute value x,- e R^. The estimated energy cost expression (1 3) above is then generalized from 
the geometric energy terms expression, EdiJV)+Espring(V). just described to also measure the deviation of the sam- 

25 pled attribute values X=/>, x^x\} f^m those of the mesh M. The geometi-ic energy cost expression. 

Edist(^)+Espri^(V). can be generalized in at least two ways to measure scalar attribute value deviation. 

A first alternative generalization is to redefine the distance meti-ic (i.e.. energy term E^ist) itself to measure distance 
inR^^. e.g.,; 

30 



This new distance metric can then be minimized using the same iterative approach described above and used in the 
35 illustrated method 380. However, this minimization would be computationally expensive since finding the optimal 
parameterization f?/of each point X/ would require projection in R^"^^, and would not be completely intuitive since these 
parametrizations are not geometrically based. 

A second alternative generalization of the geometric energy cost expression, E^j^((V)+Espnng(^) ior tine estimated 
energy cost expression (13) in the illusti^ated method 380 utilizes a separate energy term. Escaiar to measure deviation 
40 of scalar attributes. In this second alternative generalization, the energy term £dist(^} 's evaluated by minimizing the 
expression (14) as discussed above (i.e., the parametrizations bj are determined using only geometry). The separate 
energy term, ^scalar. the estimated energy cost expression (13) measures attribute deviation tiased on tiiese para- 
metrizations: 

45 

£.caiar(V) = {C3calar)' Zx || X,-0^(bi)p (17) 



50 where the constant Cscaiar assigns a relative weight between the attribute errors (Escaiar) the geometric errors 
(^dfs/)- constant Cscaiar ca" be set by the software application, or varied by the computer user witii a user interface 
conti-ol supplied by ttie software application. 

Thus, to minimize E(V, V)^E^,-JV)+E ^p^,„g(V)+£ ^^,^^(V) . the illustrated method 380 first finds the vertex posi- 
tion Vs minimizing ^rf/s/K^+^spnngl'W by alternately projecting the points onto the mesh (obtaining the parametrizations 

55 bj) and solving a linear least-squares problem. Then, using those same parameti-izations 6„ it finds the vertex attribute 
V5 minimizing E^^^^ by solving a single linear least-squares problem. This has negligible performance overhead as 
compared to the first alternative generalization. 

With reference to Figs. 21(a-c) and 22(a-c), by letting AEscoiar contribute to tine estimated cost A£ of an edge col- 
lapse, the illusti^ated PM construction method 380 obtains simplified meshes whose faces naturally adapt to tiie 
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attribute fields. For example, by minimizing AE^cajar^ the method 380 (Fig. 19) is able to select edge collapses that pre- 
serve a complex scalar attribute field (i.e.. color) of an original mesh 420 (Fig. 21(a)) having trivial geometry (a square) 
in producing a simplified mesh 422 (Figs. 21(b-c)). In this example, the 200x200 vertices of the original mesh 420 are 
reduced by the method 380 to just 400 vertices in the simplified mesh 422 while retaining much of the color quality. 
5 As another example, the method 380 selects edge collapses to preserve another scalar attribute, radios Ity, of 

another original mesh 430 (Fig. 22(a)) having 150,983 faces to produce a simplified mesh 432 (Fig. 22(b-c)) having 
10.000 faces. 

Op riizing scalar attributes at corners. 

The above described minimization of e^E scalar 'S also utilized by the illustrated PM construction method 380 when 
optimizing the scalar corner attributes S. At each vertex vj. Instead of solving for a single unknown attribute value v^, 
the illustrated method 380 partitions the corners into continuous sets (based on equivalence of corner attributes) and 
for each continuous set solves independently for its optimal attribute value. 

15 

Range constraints 

The illustrated method 380 also accounts for scalar attributes having constrained ranges. For instance, the compo- 
nents {r,g,b) of color are typically constrained to lie In a range between 0 and 1. The least-squares minimization of 
20 AE^caiar "^^V V's'^ ^^'or values outside this range. In cases where scalar attributes have constrained ranges, the illus- 
trated method 380 clips the optimized values to the given range. For least-squares minimization of a Euclidean norm, 
this Is in fact optimal. 

Normals 

25 

Surface normals {n^,nyn^) are typically constrained to have unit length, and thus their domain Is non-Cartesian. 
Optimizing over normals would therefore require minimization of a nonlinear functional with nonlinear constraints. The 
illustrated method 380 instead simply carries the normals through the simplification process. Specifically, the method 
380 computes the new normals at vertex vJ by Interpolating between the normals at vertices vj"^^ and ^Vno+z+r'*' 
30 using the a value that resulted In the best vertex position in minimizing the geometry energy term AEcjist as 
described above. Fortunately, the absolute directions of normals are less visually important than their discontinuities, 
which are preserved by the estimated energy cost evpression in the illustrated method 330, as described below. 

Preserving discontinuity curves (S^jgc) 

35 

Appearance attributes give rise to a set of discontinuity curves on the mesh, both from differences between discrete 
face attributes (e.g.. material boundaries), and from differences between scalar corner attributes (e.g., creases and 
shadow boundaries). More specifically, the attributes D and S give rise to discontinuities in the visual appearance of the 
mesh. An edge {vi.ViJ of the mesh is said to be sharp If either (1) It is a boundary edge. (2) its two adjacent faces /i and 

40 ^2 have different discrete attributes (i.e., dff ^ d/^). or (3) Its adjacent corners have different scalar attributes (I.e.. 
S(^ fi)^Sf^ f2) or Sfvk fij^S(^ f2})- Together, the set of sharp edges define a set of discontinuity curves over the mesh 
(e.g., the yellow curves in Figs. 8(a-d)). As these discontinuity curves form highly noticeable features, it is innportant to 
preserve them both topological ly and geometrically. 

The illustrated PM construction method 380 detects when a candidate edge collapse transformation would modify 

45 the topology of the discontinuity curves by testing some local conditions. Specifically, let sharp{Vj,VfJ denote that an 
edge {vj,VfJ is sharp, and let #sharp{Vj} be the number of sharp edges adjacent to a vertex vj. Then, referring to Fig. 6. 
the edge collapse transformation 110 of an edge {Vs,vt} 92 modifies the topology of discontinuity curves if either: (1) 
sharp{vs,vi} and sharp(vt,vj}, or sharp{Vs.V2} and sharpiv^.v^, or (2) #sharp{Vs}>1 and ffsharp{vj>1 and not 
sharp{Vs,v^, or (3) ^harp{vj>3 and #$harp{vj>3 and sharp{vs,vj, or (4) sharp{Vs,vJ and ^sharp{vj=l and 

50 #sharp{vj^2, or (5) sharp{Vs,vJ and ^sharp{vj=1 and ffsharp(Vs}^2. 

A number of different strategies can be employed in the PM construction method 380 to preserve discontinuity 
curves using the above described tests. One alternative strategy (hereafter referred to as the fixed discontinuity curve 
strategy) is to simply disallow an edge collapse if these tests show that the edge collapse would modify the topology of 
discontinuity curves. A more sophisticated alternative strategy which permits, buts penalizes changes to discontinuity 

55 curve topology is presented below. 

To also preserve the geometry of the discontinuity curves, the illustrated method 380 further samples an additional 
set of points X^^/^ from the sharp edges of M, and defines an additional energy term E^fsc '^^ the estimated energy cost 
expression (13) equal to the total squared distances of each of these points to the discontinuity curve from which it was 
sampled. In other words, Ed/sc is defined just like E(//s/, except that the points X^ji^c ^^e constrained to project onto a set 
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of sharp edges in the mesh. In effect, the method 380 solves a curve fitting problem embedded within the overall surface 
fitting problem. Since all boundaries of the surface are defined to be discontinuity curves, our procedure preserves 
boundary geometry more accurately than Hoppe93. 

Referring to Figs. 23(a-c). the benefit of employing the additional E^jsc energy term in the energy cost expression 

5 (1 3) is demonstrated by the sinplified meshes 440 (Fig. 23(a)). and 442 (Fig. 23(b)). Both meshes 440 and 442 were 
simplified to 2000 faces, only the mesh 440 was simplified without the E^y/sc energy term in the energy cost expression 
(13) whereas the mesh 442 was simplified with the E^sc energy term. As a result, the mesh 442 is a much better 
approximation visually of the original mesh than the mesh 440 due to discontinuity curve preservation. This is particu- 
larly apparent with respect to the topology of the discontinuity curves defining the windows In the model. Some of the 

to discontinuity curves of the mesh are indicated with yeilow lines in Figs. 23(a-c). 

Permitting changes to topology of discontinuity curves. 

Referring still to Figs. 23(a-c). some meshes contain numerous discontinuity curves, and these curves may delimit 
15 features that are too small to be interesting when viewed from a distance. In such cases, strictly preserving the topology 
of the discontinuity curves unnecessarily curtails simplification. In an alternative strategy for preserving discontinuity 
curves, the PM construction method 380 permits changes to the topology of the discontinuity curves, but penalizes 
such changes. When a candidate edge collapse ecol({Vs,vJ) changes the topology of the discontinuity curves of the 
mesh, the method 380 adds to its estimated energy cost a5 the value 

where \X^isc,ivsM]\ 's the number of points of X^i^c currently projecting onto {Vs,vJ. 

That simple strategy, although ad hoc, has proven very effective. To illustrate, mesh 442 (Fig. 23(b)) was simplified 

35 by the method 380 using the fixed discontinuity curve preservation strategy to 2000 faces, while mesh 444 (Fig. 23(c)) 
was simplified to 2000 faces by the preservation strategy which only penalizes changes to discontinuity curves. With 
the strategy allowing discontinuity curve changes, the thin dark gray window frames are allowed to vanish in the mesh 
444. In the mesh 442, however, the fixed discontinuity curve preservation strategy forces the window frames to stay 
resulting in a poorer quality simplified mesh. 

30 The illustrated PM construction method 380 (Fig. 19) is one of many possible PM construction methods with vary- 

ing trade-offs of speed and accuracy. A much simpler alternative PM construction method is to select legal edge col- 
lapse transformations' at random. (Some local conditions must be satisfied for an edge collapse to be legal, i.e., 
manifold preserving described in Hoppe93.) While crude, this scheme has the advantage of being very fast. Unfortu- 
nately, this method generally provides poorer low I evel-of -detail approximations (i.e.. the progressive meshes A/f closest 

35 to the base mesh in the progressive mesh sequence) to the original arbitrary mesh M. 

A less crude alternative PM construction method uses a simple heuristic, such as the "distance to plane" metric 
described in Schroeder-etal92. as a basis for improving the edge collapse selection strategy. 

Having described and illustrated the principles of my invention with reference to an illustrated embodiment, It will 
be recognized that the illustrated embodiment can be modified in arrangement and detail without departing from such 

40 principles. It should be understood that the programs, processes, or methods described herein are not related or limited 
to any particular type of computer apparatus, unless indicated otherwise. Various types of general purpose or special- 
ized computer apparatus may be used with or perform operations in accordance with the teachings described herein. 
Elements of the illustrated embodiment shown in software may be implemented in hardware and vice versa. 

In view of the many possible embodiments to which the principles of my invention may be applied. It should be rec- 

45 ognized that the detailed embodiments are illustrative only and should not be taken as limiting the scope of my inven- 
tion. Rather. I claim as my invention all such embodiments as may come within the scope and spirit of the following 
claims and equivalents thereto. 

Claims 

50 

1 . A method of displaying selectively refined computer graphics views of a multi -dimensional object represented in a 
progressive resolution data structure having a base mesh record and a stream of mesh refinement records, the 
base mesh record defining a base mesh representative of the object at a low level of detail, the mesh refinement 
records defining a sequence of mesh refinement transformations for refining the base mesh into an arbitrary mesh 
55 representative of the object at a high level of detail, the mesh refinement transformations being complete, the 
method comprising: 

forming a selectively refined mesh at an initial coarse level of detail from the base mesh record; 
for each of a plurality of the mesh refinement records in the stream, performing the steps of: 
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(a) checking whether the mesh refinement transformation defined by the mesh refinement record meets a 
selection criteria for limiting refinement to a desired portion of the object; and 

(b) if the mesh refinement transformation defined by the mesh refinement record meets the selection cri- 
teria, applying such mesh refinement transformation to the selectively refined mesh and thereby increas- 
ing the level of detail of the selectively refined mesh in the desired portion of the object; and 
rendering and displaying a computer graphics view of the object based on the selectively refined mesh. 

2. The method of claim 1 wherein the mesh refinement transformations are vertex split transformations, each of which- 
-^lodify a spilt vertex having two side vertices lo introduce a new vertex and at 'east one new face. 

3. "he method of claim 2 wherein the step of checking whether the mesh refinement transformation meets the selec- 
tion criteria comprises: 

checking whether the split vertex and the two side vertices are present in the selectively refined mesh. 

4. The method of claim 2 wherein the step of checking whether the mesh refinement transformation meets the selec- 
tion criteria comprises: 

checking whether closest living ancestors of the two side vertices are adjacent to the split vertex in the selec- 
tively refined mesh. 

5. The method of claim 2 wherein the step of checking whether the mesh refinement transformation meets the selec- 
tion criteria comprises: 

checking whether the split vertex is within the desired portion of the object. 

6. The method of claim 2 wherein the step of checking whether the mesh refinement transformation meets the selec- 
tion criteria comprises: 

checking whether any of a plurality of faces of the selectively refined mesh that are adjacent to the split vertex 
are within the desired portion of the object. 

7. The method of claim 2 wherein the step of checking whether the mesh refinement transformation meets the selec- 
tion criteria comprises: 

calculating a signed projected screen area of each of a plurality of faces of the selectively refined mesh that 
are adjacent to the split vertex, the signed projected screen area of each face having a sign and a magnitude; 
and 

checking whether the faces all have signed projected screen areas with equal signs. 

8. The method of claim 2 wherein the step of checking whether the mesh refinement transformation meets the selec- 
tion criteria comprises: 

calculating a signed projected screen area of each of a plurality of faces of the selectively refined mesh that 
are adjacent to the split vertex, the signed projected screen area of each face having a sign and a magnitude; 
and 

checking whether a sum of the signed projected screen areas of the faces is greater than a predetermined 
screen area threshold. 

9. The method of claim 1 comprising: 

determining that a mesh refinement transformation does not meet the selection criteria if the mesh refinement 
transformation modifies a portion of the selectively refined mesh within the desired portion of the object, but 
not visible in the computer graphics view. 

10. The method according to any one of claims 1-9 comprising: 

constructing a geomorph for interpolating between two le/eis of detail of the selectively refined mesh according 
to a blend parameter; 
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evaluating the geomorph at a plurality of values of the blend parameter; and 

rendering and displaying conrtputer graphics views of the object based on the geomorph evaluated at the val- 
ues whereby the computer graphics views form a smooth visual transition between the two levels of detail. 

5 11. The method according to any one of claims 1 -9 wherein the computer graphics view is a view of a portion of the 
object within a view frustrum. and the selection criteria limits refinement to the portion of the object within the view 
frustrum. 

1 2. A computer graphics system for displaying selectively refined views of a multi -dimensional object, comprising: 

tO 

a data storage memory for storing a progressive resolution data structure having a base mesh record and a 
stream of mesh refinement records, the base mesh record defining a base mesh representative of the object 
at a low level of detail, the mesh refinement records defining a sequence of mesh refinement transformations 
for refining the base mesh into an arbitrary mesh representative of the object at a high level of detail, the mesh 

75 refinement transformations being complete; 

a selective refinement processor for forming a selectively refined mesh at an initial coarse level of detail from 
the base mesh record, for checking whether the mesh refinement transformation defined by each of a plurality 
of the mesh refinement records In the stream meets a selection criteria for limiting refinement to a desired por- 
tion of the object, and applying those of the mesh refinement transformations that meet the selection criteria to 

20 the selectively refined mesh thereby increasing the level of detail of the selectively refined mesh in the desired 

portion of the object; 

a graphics engine for rendering a computer graphics view of the object based on the selectively refined mesh; 
and 

a display device for displaying the computer graphics view. 

25 

1 3. The computer graphics system of claim 1 2 wherein the mesh refinement transformations are vertex split transfor- 
mations, each of which modify a split vertex having two side vertices to introduce a new vertex and at least one new 
face. 

30 1 4. The computer graphics system according to any one of claims 12 wherein the computer graphics view is a view of 
a portion of the object within a view frustrum. and the selection criteria limits refinement to the portion of the object 
within the view frustrum. 

1 5. The computer graphics system according to any one of claims 12-14 comprising: 

35 

a geomorph processor for constructing a geomorph which interpolates between two levels of detail of the 
selectively refined mesh according to a blend parameter, and for evaluating the geomorph at a plurality of val- 
ues of the blend parameter; and 

the graphics engine rendering computer graphics views of the object based on the geomorph evaluated at the 
40 values for a smooth visual transition between the two levels of detail. 
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FIG. 1(a) (Prior an) F[G. 1(b) (Prior an) FiG. Kc) (Prior an) FIG. Ud) (Prior an) 




FIG- 4(a) (Prior an) FIG. -i^b) (Prior an) FIG. 4(.c) (.Prior an) FIG. 4(d) (Prior an) 
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FIG. 9B 
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FIG. 12A 
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